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ABSTRACT 


This  interim  report  demonstrates  the  feasibility  of  conducting  a 
dynamic  analysis  of  ASW  effectiveness  through  the  application  of  queuing 
theory.  The  ASW  effectiveness  of  both  the  individual  ASW  unit  and  the 
aggregated  ASW  force  are  considered.  Analytical  models  are  formulated 
representing  both  levels  of  capability,  and  appropriate  computational 
techniques  are  described  and  illustrated  by  selected  examples.  Areas 
requiring  further  research  and  development  are  defined,  and  recommenda¬ 
tions  for  near  term  research  are  included  which  are  in  consonance  with 
a  continuing  ASW  evaluation  program. 


PREFACE 


The  research  reported  in  this  interim  report  was  conducted  as  a 
portion  of  a  continuing  program  directed  toward  the  development  of  a 
queuing  methodology  for  evaluating  ASW  system  effectiveness.  The  proj¬ 
ect  was  sponsored  by  the  Director,  Naval  Analysis  Programs,  of  the  Office 
of  Naval  Research.  Mr.  R.  H.  Dickman  was  the  ONR  Project  Scientific 
Officer. 

The  research  effort  was  performed  jointly  by  the  Naval  Warfare 
Research  Center,  Mr.  L.  J.  Low,  Director,  and  the  Information  Sciences 
Laboratory,  Mr.  D.  R.  Brown,  Director,  of  Stanford  Research  Institute. 

Mr.  M.  W.  Zumwalt  of  NWRC  was  the  project  leader. 

The  following  Stanford  Research  Institute  personnel  contributed 
directly  to  the  accomplishment  of  the  study: 

Thomas  L.  Humphrey  Samuel  Schechter 

Andrew  J.  Korsak  Marvin  W.  Zumwalt 

Robert  S.  Ratner  William  H.  Zwisler 

Marilyn  J  Rundberg 

In  addition,  Lieut,  Thomas  D.  Kenneally,  USN,  and  Lieut.  Norman  T.  Saunders 
USCG,  from  the  U.S.  Naval  Postgraduate  School,  Monterey,  California,  pro¬ 
vided  significant  analytical  assistance  in  the  implementation  of  the  ASW 
force  effectiveness  model. 
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STUDY  SUMMARY 


Research  Objective  and  Scope 

The  ultimate  objective  of  the  research  reported  on  herein  is  to 
develop  a  queuing  methodology  for  analyzing  the  effectiveness  of  ASW  oper¬ 
ations.  The  -motivation  for  basing  an  ASW  model  on  mathematical  queuing 
is  to  account  for  congestion  phenomena  that  may  occur  as  several  contacts 
are  "serviced"  by  an  ASW  system.  This  service  consists  of  the  functions 
of  detection,,  localization,  attack,  kill,  classification,  and  command  and 
control. 

The  present  report  does  not  contain  the  completed  methodology.  It 
does  present  the  first  necessary  steps  toward  conceptualizing  the  tech¬ 
nical  aspects  of  modeling  ASW  operations  in  terms  of  queuing  theory,  and 
contains  the  calculation  of  a  number  of  statistical  parameters  for  the 
initial  queuing  models  developed.  The  parameters  identified  are  helpful 
for  calculating  ASW  systems  measures  of  effectiveness.  One  such  param¬ 
eter  is  the  mean  time  to  prosecuto  a  contact  from  detection  to  attack  and 
kill. 

The  report  will  be  of  interest  primarily  to  those  engaged  in  con¬ 
structing  models  for  ASW  or  other  areas  where  congestion  may  significantly 
influence  the  assessment  of  effectiveness.  It  should  also  be  useful  to 
operational  personnel  by  reason  of  its  orientation. 


Approach 


The  approach  taken  consists  of  two  parts: 


1.  Analysis  of  an  ASW  unit  with  respect  to  detection,  locali¬ 
zation:,  attack,  and  kill  functions 
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2.  Analysis  of  an  ASW  force  consisting  of  individual  inter¬ 
acting  units  (such  as  the  effects  of  detection  capability) . 

To  facilitate  model  formulation,  only  the  four  functions  of  detection , 
localization,  attack,  and  kill  have  been  considered.  Classification  and 
command  and  control'  were  omitted  for  the  time  being  but  will  be  included 
later.. 

> 

•Findings 

Conclusions 

Specific  elements  of  queuing  theory  have  been  found  appl ' table  to 
the  modeling  of  congestion  phenomena  that  might  be  encountered  by  indi¬ 
vidual  surface-  ASW  .unfits  and  ASW  force  configurations,  in.  the  case  of 
the  ASW  units,  closed-form  analytical  results  could  not  be  obtained. 
However,  suitable  models  have  been  developed  using  a  synthesis  of  the 
theory  of  Markov  processes  and  flow  graph  analysis  techniques .  Computer 
implementation  of  the  models  yielded  probability  distributions  from  which 
certain  measures  of  effectiveness  c  an  be  obtained.  In  the  case  of  ASW 
force  analysis,,  closed- form  solutions  have  been  obtained  for  direct  com¬ 
puter  calculation  of  particular  measures  of  effectiveness:,  assuming 
simplified  representation  for  the  ASW  units  comprising  the  force.  Ex¬ 
amples  of  measures  of  effectiveness  obtainable  from  the  initial  models 
are: 

•  Expected  number  of  contacts  lost  while  in  the  ASW  system 
(over  a  given  period'  of  time) 

•  Probability  of  missing  a  true  contact  (failure  to  detect) 
for  a  given  level  of  contact  activity  (false  and  true) 

•  Expected  lime  to  detection 

•  Expected:  time  from  detection  to  kill . 
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The  current  method  of  approach  suggests  that  further  detail  in  rep¬ 
resenting  both  individual  ASW  units  and  force  configurations  is  possible 
without  rendering  the  models  computationally  intractable.  (The  basic 
philosophy  is  that  the  Markov  modeling  approach  for  ASW  units  should  be 
pursued  as  far  as  possible  so-  long  as  computational  tractability  is 
maintained.)  It  appears,  however ,  that  whole  ASW  force  models  cannot 
be  obtained  simply  by  compounding  detailed  unit  models.,  and  that  the  two¬ 
pronged  approach  used  so  far  will  be  most  likely  to  succeed  in  further 
investigations.  Information:  obtained  on  congestion  behavior  of  ASW  units 
will,  of  course,  be  of  value  in  creating  approximate  models  for  their 
behavior  in  force  models.  As  an  example  of  this,  the  curves  for  distri¬ 
butions  of  saturated  and  unsaturated  duration  of  the  ASW  unit  considered 
thus  far  appear  to  be  approximated  by  an  exponential  distribution.  This 
result  is  used  in  the  force  model. 


Potential  Applications 


Some  of  the  applications  of  the  completed  methodology  are  as  follows 

1.  Comparison  of  congestion  effects  in  an  ASW  unit  or  force 
with  improved  capability  in  the  detection,  classification, 
localization,  attack,  and  kill  functions.  This  could  aid 
in  the  study  of  tradeoffs  for  concentrating  effort  in  ASW 
operations  to  achieve  maximal  capability,  as  well  as  in 
decisions  on  where  to  focus  development  of  improved  hard¬ 
ware.  For  such  purposes,  modeling  of  the  bottlenecks  ir. 

an  ASW  system  and  how  they  interact  in  some  degree  of  detail 
should  prove  valuable  in  assessing  the  effects  of  changes  in 
system  capabilities. 

2.  Evaluation  of  ASW  force  performance  for  alternative  force 
mixes  and  force  deployment  geometries.  The  queuing  method¬ 
ology  is  unique  in  that  it  will  provide  an  approach  for 
assessing  the  dynamic  manges  in  force  performance  due  to 
changes  in  force  mix  '.nd  deployment  geometr-y.,  that  is,  changes 
in  force  mix  due  to  combat  or  operational  attrition ,  and  the 
changes  in  deployment  geometry  due  to  assignment  of  an  ASW 
unit  to  prosecute  a  contact. 
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GLOSSARY  OF  TERMS 


ARRIVAL  PROCESS 


COMPETING  PROCESS 
MODEL 


CONTACT 


CUSTOMER 


DYNAMIC  SYSTEM 


FLOW  GRAPH 


MARKOV  PROCESS 


—  A  random  process  describing  the  probability 
distribution  of  interarrival  periods  for 
customers  entering  a  queuing  system. 

—  A  Semi-Markov  process  representation  that  phrases 
it  in  ■'erms  of  independently  operating  stochastic 
processes  which  behave  line  random  time  clocks, 
the  first  of  which  goes  off  with  an  alarm  being 
the  one  whose  time  is  used  to  determine  the  next 
transition  interval  for  the  Semi-Markov  process. 

—  A  stimulus  which  has  been  detected  by  an  ASW 
unit  or  force  and  is  engaging  the  attention  of 
an  ASW  crew. 

—  An  object  desiring  service  by  the  service  system 
of  a  queuing  system  and  having  to  possibly  wait 
in  the  queue  of  the  system. 

—  Term  used  in  systems  analysis  to  differentiate  a 
time-varying  model  from  a  static  one,  i.e.,  a  model 
with  states  changing  in  time  and  consideration  of 
mechanics  of  their  changes. 

—  A  graphical  representation  of  a  set  of  linear 
equations,  be  they  algebraic,  differential,  or 
whatever.  The  nodes  of  the  graph  correspond  to 
the  variables  and  the  arcs  correspond  to  the 
linear  relations  between  the  variables,  the  linear 
coefficients  being  the  weight  factors  associated 
with  the  arcs  of  the  graph. 

—  A  time  series  of  change  events  with  the  property 
that  the  probabilities  of  what  will  happen  next 
(i.e.,  what  state  transitions  can  occur  and  with 
what  probability)  are  independent  of  whatever 
happened  before  except  for  whatever  is  happening 
now,  i.e.,  only  the  present  state  determines  the 
future. 


QUEUE 


—  A  mathematical  model  for  a  waiting  line. 


QUEUING  SYSTEM 

SATURATED  SYSTEM 
TIME 


SEMI -MARKOV 
PROCESS 


SERVER 

SERVICE  DISCIPLINE 

SERVICE  PHASE 

SERVICE  STAGE 

SERVICE  STATION 
SERVICE  SYSTEM 

STEADY  STATE 


—  A  mathematical  model  for  a  queue  along  with  a 
service  system. 

—  The  duration  when  an  ASW  system  is  overburdened 
by  processing  contacts  already  obtained  and  is 
incapable  of  any  further  detections  of  stimuli . 

—  A  time  series  of  events  very  much  like  a  Markov 
process  except  it  is  more  general  in  the  sense 
that  holding  times  prior  to  new  transitions  are 
dependent  on  wnere  the  transition  is  going  to  be 
to,  as  well  as  what  state  the  system  is  in  now. 

In  a  Markov  process,  the  holding  times  at  the 
states  are  determined  by  knowing  only  what  state 
the  system  is  in  now.  For  a  precise  definition, 
see  Appendix  A. 

—  A  facility  for  service  in  a  service  system  of  a 
queuing  system. 

—  A  set  of  rules  for  picking  the  next  customer  to 
be  served  out  of  a  queue. 

—  One  out  of  many  (possibly  parallel)  types  of 
service  facilities  that  a  customer  passes  through 
before  it  can  be  declared  as  "served"  in  a 
queuing  system. 

—  A  particular  level  of  penetration  of  a  customer 
into  a  service  system.  (In  the  AS W  model,  the 
first  stage  is  called  detection,  the  next  stage 
is  localization,  etc.) 

--  Another  term  for  server. 

—  An  arrangement  of  servers  such  that  customers  are 
required  to  pass  through  the  servers  in  a  specified 
series  of  service  stages,  and  at  each  service  stage 
the  customer  becomes  engaged  in  another  service 
phase. 

—  This  refers  to  equilibrium  (static)  conditions  as 
opposed  to  transient  (dynamic)  conditions. 


STIMULUS  —  An  ocean  phenomenon  that  could  potentially  result 

in  the  "detection"  of  a  contact  by  an  ASW  unit  or 
force.  The  phenomenon  may  occur  due  to  the  presence 
of  a  submarine  or  due  to  biological  sources,  acoustic 
propagation  anamolies,  or  bottom  and  surface 
acoustic  reflections. 

TRANSIENT  STATE  —  This  refers  to  a  continually  changing  situation 

before  settling  down  to  an  equilibrium. 

The  factor  that  one  obtains  as  a  multiplier  for  a 
flow  graph.  This  is  obtainable  by  algebraically 
eliminating  all  other  variables  in  the  linear 
equations  represented  by  the  flow  graph. 

UNSATURATED  SYSTEM  —  The  duration  of  a  period  when  an  ASW  system  is 
TIME  not  overburdened  and  is  available  for  detection 

of  a  stimuli. 

WAITING  TIME  —  The  duration  that  a  particular  stimulus  is 

theoretically  present  within  detection  range  but 
is  not  detected  because  the  ASW  detection  system 
is  occupied. 


TRANSMISSION 
(OF  A  FLOW 
GRAPH) 


I  INTRODUCTION 


The  purpose  of  this  research  is  to  establish  a  methodology  that  can 
be  used  to  evaluate  ASW  force  effectiveness  through  the  application  of 
the  queuing  theory.  The  methodology  represents  the  fundamental  ASW  func¬ 
tions  (detection,  classification,  etc.)  and  the  decision  rules  for  false/ 
true  target  evaluation,  and  force  allocation  within  a  time  referenced 
framework,  and  specifies  the  effects  of  system  contact  prosecution  and 
recovery  times.  The  goals  of  the  research  are  to: 

•  Establish  measures  of  effectiveness  of  ASW  systems  that  take 
into  account  their  dynamic  aspects 

•  Develop  queuing  models  for  individual  ASW  units  and  ASW 
force  operations  with  the  capability  of  accepting  experi¬ 
mental  and  fleet-operational  data 

•  Evaluate  selected  single  ASW  units  and  force  models  on  the 
basis  of  fleet-operational  data  to  demonstrate  the  utility 
of  the  methodology. 

During  the  course  of  the  study  it  was  found  to  be  expedient  to  ex¬ 
tend  the  scope  of  the  study  beyond  methodology  conceptualization  to  in¬ 
clude  derivation  of  specific  mathematical  formulations  and  illustrative 
computations  of  various  measures  of  system  effectiveness.  The  scope  of 
the  project  was  extended  in  another  manner.  Originally,  it  was  intended 
to  consider  the  system  capabilities  of  the  individual  ASW  units  in  an 
aggregated  sense.  It  quickly  became  apparent  that  this  procedure  would 
not  suffice  as  an  adequate  representation.  Accordingly,  the  internal 
functioning  of  an  individual  ASW  unit  was  investigated  in  greater  detail. 
The  net  result  of  this  investigation  was  the  development  of  the  prototype 
unit  model  discussed  in  detail  in  Section  III. 
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A  schematic  diagram  of  the  study  approach  is  presented  m  Figure  1-1. 
Each  of  the  elements  of  Figure  1-1  is  discussed  in  the  report  sections 
that  follow  with  the  exception  of  the  first  element :  the  real  world  of 
operational  ASW.  The  definition  of  ASW  functions,  the  establishment  of 
the  corresponding  queuing  analogy,  and  the  construction  of  a  force  sym¬ 
bology  and  operational  algebra  are  examined  in  Section  II.  Section  III 
derives  the  appropriate  unit  measures  of  effectiveness  and  formulates  the 
prototype  ASW  unit  model.  The  force  level  measure  of  effectiveness  and 
effectiveness  model  are  described  in  Section  IV.  Supporting  and  back¬ 
ground  mathematical  developments  for  the  unit  model  are  presented  in  the 
appendices. 


II  GENERAL  SITUATIONAL  FORMULATION 


A.  ASW  Functional  Definitions 

To  be  adequate,  t*  system  description  should  be  applicable  to  a  large 
number,  if  not  all,  of  the  different  types  of  ASW  systems,  both  in  existence 
and  postulated,  and  should  be  in  terms  that  can  be  translated  into  queuing 
equivalents.  There  are  many  ways  in  which  an  ASW  system  may  be  described. 
The  one  used  here  is  based  on  ASW  functions.  A  functional  system  approach 
provides  an  adequate  description  since,  by  its  very  nature,  it  is  suffi¬ 
ciently  general  to  be  applicable  to  all  ASW  systems;  it  is  also  appropriate 
in  that  the  functions,  if  properly  defined,  can  be  represented  as  essen¬ 
tially  discrete  actions,  which  facilitates  their  translation  into  appro¬ 
priate  queuing  equivalents. 

On  the  individual  ASW  system  level,  five  functional  capabilities  form 
the  basic  building  block  elements  for  formulating  the  queuing  description 
of  the  system:  detection,  localization,  attack,  kill  and  classification. 

At  the  ASW  force  level,  a  sixth  function  is  introduced,  i.e.,  command  and 
control. 

The  definitions,  interpretations,  and  queuing  equivalents  of  the  six 
ASW  functions  are  presented  in  Table  II-l.  Of  the  six  functions,  four  are 
readily  defined  in  terms  of  specific,  essentially  one-time  actions  and 
have  been  characterized  as  "servers"  in  queuing  terminology.  These  four 
are:  detection,  localization,  attack,  and  kill.  The  other  two  functions 
are  continuous  throughout  the  contact  prosecution  process  and  have  been 
tentatively  characterized  as  "system  or  force  control  functions"  (queue 
discipline,  contact  processing  rules,  platform  assignments,  etc.) 
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Command  &  Control  Allocation  and  control  of  AS'V  Controls  contacts  within  Establishes  time-dependent  force 

resources  available  to  force  overall  Force  System  organizational  form.  Defines 

operational  queue  system  disci¬ 
pline.  May  eliminate  contacts 
from  system  by  avoidance 


For  the  initial  unit  analysis,  primary  emphasis  has  been  placed  upon 
modeling  the  interactions  among  the  four  server  functions  urd^r  the  assump¬ 
tion  that  internal  system  queue  discipline  is  of  the  first-in-rirsc-out 
type.  This  is  equivalent  to  assuming  that  the  system  does  not  encounter 
false  targets  and  all  targets  are  equally  threatening.  The  effect  is  to 
eliminate  the  classification  function  from  the  model  formulation.  This 
was  done  to  constrain  the  complexity  of  the  model  until  greater  under¬ 
standing  is  achieved  about  the  interactions  among  the  four  server  func¬ 
tions. 

When  the  equipment/functional  relationships  in  an  ASW  system  are  con¬ 
sidered,  the  effects  of  the  multipurpose  character  of  many  of  the  equip¬ 
ments  quickly  become  appai’ent.  For  example,  the  nature  of  the  actual 
equipment  or  resource  allocations  among  the  four  server  functions  within 
a  typical  ASW  system  is  shown  in  Figure  II-l,  In  this  figure,  (X)  signifies 
primary  functional  utilization  and  (/)  implies  secondary  or  continuing 
utilization. 

Thus  whenever  a  contact  enters  the  system  (upon  completion  of  the 
detection  function  via  the  sonar  equipment)  at  least  a  portion  of  the 
sonar  capability  must  be  dedicated  to  providing  information  about  that 
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FIGURE  II-l  TYPICAL  ASW  SYSTEM  EQUIPMENT/FUNCTIONAL  RELATIONSHIPS 


contact  in  order  that  it  may  be  properly  processed.  The  detection  capa¬ 
bility  of  the  system  is  correspondingly  reduced.  Hence,  the  extent  of 
the  system' s  detection  capability  is  limited  by  the  information  rate  of 
the  sonar.  As  can  be  seen  in  Figure  I I — 1 ,  similar  conditions  apply  to 
the  other  server  functions.  The  implications  of  these  effects  will  be 
discussed  further  in  Section  III  where  the  formulation  of  the  single  ASW 
unit  model  is  described. 

B.  'Functional  Symbolic  Algebra 

Having  defined  the  ASW  functions  as  the  model  building  blocks  for 
the  single  system,  there  exists  a  need  to  structure  an  aggregation  of 
single  systems.  To  satisfy  this  requirement,  three  ASW  functional  com¬ 
ponents  are  established  and  defined,  and  a  symbology  is  constructed  to 
describe  the  component  interrelationships. 

The  three  ASW  functional  components  and  their  definitions  ire  listed 
in  Table  II-2,  In  the  functional  hierarchy  listed  in  Table  II-2,  the 
element  and  the  operating  element  constitute  the  basic  units  from  which 
specific  ASW  forces  may  be  assembled.  It  should  be  noted  that  a  platform 
need  not  possess  all  of  the  ASW  functional  capabilities  to  be  classified 
as  a  unit.  The  difference  between  a  unit  and  a  force  is  defined  in  Ta¬ 
ble  1 1 -2. 

Obviously,  the  nature  of  a  force  may  change  during  the  conduct  of  an 
operation  due  to  a  number  of  circumstances.  Chief  among  these  are:  (1) 
reallocation  of  available  resources,  (2)  attrition,  and  (3)  temporary 
inhibitions  of  unit  functional  capabilities.  In  this  request,  the  terms 
"uninhibited"  and  "inhibited"  refer  to  primary  and  secondary  utilization 
of  a  particular  functional  capability.  For  example,  a  destroyer  may  be 
operating  with  an  ASW  helicopter  in  such  a  manner  that  the  attack  and 
kill  capabilities  of  the  destroyer  are  subordinated  to  those  of  the 
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Table  I 1-2 

ASW  FUNCTIONAL  COMPONENT  DEFINITIONS 


ASW 

Functional 

Components 

Definition 

Unit 

A  single  platform  (ship,  aircraft,  helicopter, 
submarine)  which  possesses  one  or  more 
complete  or  partial  functional  ASW 
capabilities 

Operating  Unit 

A  unit  which  is  employed  in  a  manner  such 
that  one  or  more  of  its  functional 
capabilities  are  inhibited 

Force 

Two  or  more  units  and/or  operating  units 
which,  collectively,  comprise  sufficient 
uninhibited  functional  capability  for  mission 
accomplishment — where  nussion  accomplishment 
is  defined  as  all  necessary  ASW  functions 
from  detection  to  kill 

helicopter.  In  this  case,  the  attack  and  kill  capabilities  of  the  de¬ 
stroyer  do  not  cease  to  exist,  but,  insofar  as  the  force  is  concerned, 
they  are  "inhibited"  in  favor  of  the  helicopter  capabilities.  Thus  the 
nature  of  the  unit  may  change  to  that  of  an  operating  unit,  and  vice  versa. 

A  force  is  not  completely  characterized  by  simply  listing  the  assigned 
units  and  operating  units.  An  essential  ingredient  is  the  operational  doc¬ 
trine  and  procedures  that  comprise  the  management  or  organization  of  the 
force.  Clearly,  the  same  units  and  operating  units  may  be  assembled  and 
directed  in  many  ways;  each  one  of  which  constitutes  a  force  with  a  dif¬ 
fering  level  of  effectiveness.  To  facilitate  the  description  of  these 
many  possible  force  structures,  an  ASW  functional  symbology  has  been 


developed  as  shown  in  Table  I 1-3.  The  vocabulary  is  developed  only  to  a 
stage  which  is  consistent  with  the  scope  of  Jie  current  effort  and  which 
demonstrates  procedure  and  its  application. 

The  majo"ity  of  the  symbols  contained  in  Table  II-3  have  either  been 
previously  explained  or  are  self-explanatory .  Several  examples  of  the  use 
of  these  symbols  are  given  in  Figure  I 1-2. 

In  Figure  II-2A  a  detection  opc  ating  unit  is  controlling  an  attacker 
unit.  This  example  illustrates  the  use  of  the  subscript  to  indicate  a 
capability  which  is  required  of  a  unit  or  operating  unit  in  order  to  ade¬ 
quately  apply  the  primary  o.  uninhibited  capability.  Only  the  four  server 
capabilities  are  shown  as  inhibited  or  uninhioited.  The  classification 
function,  since  it  affects  all  of  the  server  capabilities,  is  indicated 
by  the  "C"  subscripting  the  last  uninhibited  capability.  To  avoid  unnec¬ 
essary  complexity,  certain  obvious  required  (subscripted)  capabilities 
may  be  omitted  from  the  unit  and/or  operating  unit  symbols.  As  an  example, 
the  required  localization  capability  is  omitted  from  the  attacker  element 
of  Figure  II-2A  on  the  assumption  that  a  knowledgeable  observer  will  rec¬ 
ognize  the  requirement  without  the  necessity  of  including  the  extra  symbol. 

The  examples  of  Figure  II-2  are  not  just  arbitrary  collections  of 
symbols.  Each  example  is  taken  from  a  real  world  ASW  situation.  Thus 
Figure  II-2A  represents  the  functional  organization  of  a  destroyer  (the 
operating  unit)  and  a  LAMPS  helicopter  team.  Figure  II-2B  could  be  inter¬ 
preted  as  an  ASW  helicopter  unit  (wi Ihout  weapon  capability)  working  with 
a  destroyer  or  ASW  aircraft  attacker  operating  unit.  Figure  II-2C  repre¬ 
sents  the  typical  two  destroyer  search  and  attack  unit  (SAU) .  Figure  II-2D 
depicts  what  may  well  bo  a  future  ASW  configuration,  i.e.,  two  destroyers, 
or  possibly  two  escort  SSNs,  each  equipped  with  a  form  of  the  towed  linear 
array  system.  In  this  case,  localization  will  require  the  integrated  per¬ 
formance  of  both  operating  units;  hence  the  indication  of  localization 
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FIGURE  11-2  EXAMPLES  OF  ASW  SYMBOLIC  CONFIGURA' 


functional  interdependence.  It  should  be  noted  that  all  of  the  examples 
discussed  so  far  constitute  ASW  "forces"  in  the  context  of  the  ASW  func¬ 
tional  components  previously  defined. 

Figure  II-2E  illustrates  the  application  of  the  symbology  to  a  type 
of  organization  that  has  been  associated  with  the  term  "ASW  force."  This 
force  consists  of  four  destroyer  operating  units  organized  into,  primarily, 
two  subgroups  each  with  its  own  LAMPS  attacker  unit.  In  case  of  simul¬ 
taneous  destroyer  contacts  within  a  subgroup,  there  is  a  "competition" 
between  the  destroyers  for  the  services  of  the  attacker  unit.  The  sixth 
ASW  function,  command  and  control  (C/C  in  Figure  II-2E),  must  now  be  in¬ 
troduced  into  the  situation.  The  various  command  and  conti’ol  decisions 
that  may  be  made  in  a  situation  such  as  this  will  not  be  dwelt  upon  here; 
they  will  be  touched  upon  briefly  in  succeeding  paragraphs.  To  complete 
the  description  of  this  specific  example,  the  command  and  control  operating 
unit  of  Figure  II-2E  can  be  interpreted  as  being  an  ASW  aircraft  carrier 
(CVS)  or  a  carrier  with  an  integrated  air  group  (the  CV  concept). 

The  force  representation  of  Figure  II-2E  can  be  misleading.  To  those 
familiar  with  ASW  and,  in  particular,  ASW  formations,  Figure  II-2E  may 
appear  to  represent  spatial  as  well  as  functional  relationships.  While 
the  various  symbols  may  be  positioned  in  some  form  of  spatial  order,  this 
is  not  a  requirement  for  the  use  of  symbolic  algebra.  The  purpose  of  the 
symbolic  vocabulary  and  algebra  is  to  display  the  ASW  functional  relation¬ 
ships  within  a  given  force.  This  point  may  be  better  appreciated  by  con¬ 
sidering  the  ASW  force  shown  in  Figure  II-3.  In  this  figure  the  absence 
of  any  attempt  to  represent  spatial  z’elationships  should  be  obvious,  yet 
the  functional  relationships  are  clearly  defined.  By  way  of  interpretation, 
the  force  shown  in  Figure  II-3  represents  a  command  and  control  operating 
unit,  either  a  CVS  or  a  CV,  that  is  controlling  four  ASW  aircraft  (units  A, 
B,  C,  and  D)  ,  three  AS'1.'  helicopters  (units  1,  2,  and  3),  and  two  ASW  groups 
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FIGURE  1 1-3  ASW  FORCE  FUNCTIONAL  REPRESENTATION 


consisting  of  two  destroyer  detection  operating  units  and  an  ASW  helicopter 
attack  operating  unit.  To  avoid  unnecessary  complexity  in  Figure  II-3, 
only  the  principal  lines  of  information  transfer  are  shown.  The  situation 
in  Figure  I 1-3  may  also  be  considered  to  represent  the  force  status  during 
the  period  when  only  ASW  search  is  being  conducted.  The  actual  force  con¬ 
figuration  and  organization  may  take  many  forms,  depending  upon  the  tac¬ 
tical  situation  and/or  the  various  command  and  control  decisions  imple¬ 
mented  once  a  target  is  encountered.  For  example,  the  force  organization 
may  undergo  the  changes  indicated  in  Figure  I 1-4  after  a  target  is  de¬ 
tected.  In  this  instance,  the  aircraft  unit  D  has  made  contact.  A  com¬ 
mand  and  control  decision  has  been  made  to  detach  the  attacker  operating 
unit  from  group  1  and  assign  it  to  assist  D.  The  remaining  destroyers  of 
group  1  have  been  retained,  organizationally,  as  a  group  or  SAU.  Note 
that,  in  this  case,  the  nature  of  each  destroyer  in  group  1  changes  from 
that  of  an  operating  unit  to  that  of  a  unit.  This  brief  example  illustrates 
how  the  symbolic  vocabulary  and  the  associated  operational  algebra  can  be 
used  to  depict  the  time  dependent  functional  capability  changes  an  ASW 
force  may  undergo  during  a  dynamic  ASW  engagement. 


FIGURE  II— 4  ASW  FORCE  FUNCTIONAL  REPRESENTATION  (MODIFIED) 


Ill  UNIT  MODEL 


A.  Introduction 

1 .  Description 

For  the  unit  ASW  model  it  is  assumed  that,  as  a  contact  passes 
through  the  system,  it  occupies  a  unit  of  sonar  service  while  in  the  first 
"server,"  i.e.,  while  undergoing  detection.  Throughout  its  stay  in  the 
system  it  continues  to  occupy  that  unit  of  sonar  service,  even  when  it  is 
in  any  of  the  three  queues  following  the  first  server.  Similarly,  the 
CIC  resource  is  assumed  to  be  occupied  at  the  rate  of  one  unit  per  contact 
from  the  moment  of  entering  "localization"  and  up  to  leaving  the  system, 
etc. 

Observe  that  we  have  been  led  to  model  discretely  the  capabili¬ 
ties  of  each  functional  server  to  service  multiple  contacts  simultaneously. 
It  is  conceptually  clear  that  there  are  limits  on  simultaneous  functional 
service.  Thus  it  is  reasonable  to  establish  capacities  on  simultaneous 
service.  Nonetheless,  establishment  of  definitive  values  for  such  capac¬ 
ities  must  await  future  attention.  The  representation  used  weighs  all 
contacts  uniformly  as  regards  the  load  each  places  on  a  server,  or  equiv¬ 
alently,  as  regards  the  difficulty  of  service. 

The  command  and  control  and  classification  functions  have  been 
omitted  from  the  present  model;  they  will  be  represented  as  the  processes 
that  determine  priority  of  service  and  that  specify  alternative  paths 
through  the  system  networks  (Section  III-B).  Similarly,  certain  other 
features  of  an  ASW  engagement  lave  not  yet  been  modeled.  Some  of  these 
are:  (1)  hand-off  of  functions  from  other  ASW  units,  (2)  lost  contact 

processes,  and  (3)  unsuccessful  kill  attempts  and  reattack  process. 


2. 


Outline  of  Queuing  Model 


Based  on  the  above  considerations,  the  initial  multiple  queuing 
situation  of  Figure  III-l  was  selected  for  study.  The  meaning  of  Figure 
III-l  follows. 

Acoustic  stimuli,  be  they  locally  generated  as  they  become  avail¬ 
able  for  detection,  await  the  availability  of  the  detection  server  D  in  a 
fictitious  queue  QD.  This  queue  is  created  to  measure  the  statistics  of 
missed  and  delayed  detection  due  to  preoccupation  of  the  detection  process. 
As  soon  as  an  element  of  the  detection  server  is  available  (for  specificity 
we  use  here  four  degrees  of  detection  server  occupancy)  the  stimulus  prog¬ 
resses  "through"  the  detection  phase  according  to  prescribed  detection 
time  statistics.  From  this  point  the  stimulus  is  a  contact.  Contacts 
not  in  process  of  localization  are  represented  as  "waiting"  in  a  queue 
Ql  in  the  same  manner  as  the  contacts  progressed  from  a  queue  awaiting 
detection  to  a  queue  awaiting  localization.  So,  the  contacts  progress 
from  the  latter  queue,  through  the  localization  process,  through  a  queue 
awaiting  the  attack  function,  etc.,  through  "service"  by  the  kill  func¬ 
tion. 

The  number  of  parallel  "service  units”  at  each  stage  was  selected 
for  development  purposes  to  be  just  enough  so  that  queuing  is  possible  at 
the  following  stage.  That  is,  in  view  of  service  at  each  stage  being 
"tied  up"  until  a  contact  leaves  the  system,  it  is  necessary  to  have  at 
least  one  less  unit  of  service  at  each  stage  as  one  progresses.  In  other 
words,  we  selected  the  server  capacities  to  be  simple  enough  for  a  first 
study,  but  complicated  enought  to  allow  queues  to  form  in  all  possible 
stages. 

An  alternative  schematic  representation  of  the  situation  is 
presented  in  Figure  I I 1-2.  This  figure  shows  the  idea  of  the  presence 
of  a  contact  being  felt  in  several  places  at  once,  in  that  a  contact 


1 1 1-2 


MM 


3S99BBJSSHHSS9C 


II 1-3 


FIGURE  II1-2  ALTERNATIVE  REPRESENTATION  FOR  FIGURE  III-1 


progressively  uses  the  resource  of  sonar  (detection),  then  sonar  and  CIC 
(localization),  etc.,  until  it  finally  exits  from  the  system. 

As  a  start  it  was  assumed  that  all  parallel  service  units  at 
each  "stage"  have  the  same  exponential  "service"  distribution,  ”'ith  param¬ 
eters  as  in  Figure  III-l.  It  musr  be  remembered  that  a  "completion"  of 
a  service  does  not  render  a  given  service  unit  available  for  other  con¬ 
tacts;  such  a  completion  merely  tells  when  a  transition  of  a  contact  to 
the  next  state  occurs  (either  into  the  next  "server"  or  the  queue  aneacl 
of  it).  The  input  distribution  for  all  true  and  false  contacts  is  also 
assumed  to  be  exponential  with  parameter  \.  Both  the  input  and  service 
distributions  can  be  made  more  general,  using  the  so-called  "method  of 
stages,"  which  amounts  to  setting  up  a  network  of  parallel  and  series 
exponential  holding  times. 

3 .  Measures  of  Effectiveness 

Various  attributes  of  factors  associated  with  queuing  systems 
in  general  were  considered  in  structuring  a  suitable  model  for  evaluating 
ASW  system  performance.  The  primary  statistical  factors  were  judged  to 
be: 

•  Unsaturated  time  distribution  (for  entire  system) 

•  Saturated  time  distribution  (for  entire  system) 

.  Waiting  time  distribution  (in  first  queue,  i.e,,  ahead 
of  detection) 

,  Distribution  of  time  spent  in  entire  system. 

Other  factors  of  significance  are: 

,  Distribution  of  queue  lengths  at  the  various  stages 

•  Distribution  of  the  number  of  contacts  exiting  any  stage 
in  a  given  time. 
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The  primary  statistical  factors  are  needed  in  the  force  effectiveness 
model  described  in  Section  IV.  The  others  are  useful  for  evaluating  the 
effects  of  physical  storage  capacity  or  other  limitations  at  various  stages 
of  the  ASW  system,  and  for  determining  the  nature  of  the  input  distribu¬ 
tions  to  other  ASW  platform  queuing  models  coupled  to  a  given  one  through 
a  command  and  control  hand-off  system. 

The  above  statistical  factors  lead  to  calculation  of  the  follow¬ 
ing  possible  measures  of  effectiveness  of  an  ASW  unit: 

.  Probability  that  a  contact  is  lost 

.  Expected  number  of  contacts  lost  while  in  system,  over 
a  given  period  of  time 

•  Probability  of  missing  a  true  contact  (failure  to 
detect)  for  a  given  level  of  contact  activity  (false 
and  true) 

,  Expected  time  to  detect 

,  Expected  time  from  detection  to  kill. 

When  the  classification  function  is  added  to  the  model,  the 
following  additional  measures  will  be  obtainable: 

.  Probability  of  losing  a  contact  before  classifying 

,  Expected  time  to  classify 

.  Probability  that  a  false  contact  is  pursued  all  the  way 
through  to  the  kill  function. 

Work  to  date  was  aimed  only  at  numerical  calculation  of  the  sta¬ 
tistical  distributions  as  these  are  the  most  difficult  to  obtain.  The 
above  measures-of-ef fectiveness,  which  are  relatively  easy  to  obtain  once 
the  distributions  are  known,  wore  not  considered  in  the  present  effort 
so  far,  lacking  fleet-operational  data  to  render  them  meaningful. 
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4. 


Approach  Selected  for  Model  Analysis 


Fortunately,  a  suitable  approach  to  the  ASW  problem  has  arisen, 
in  spite  of  the  difficulties  with  attempts  at  simpler  models.  The  model 
is  involved  but,  on  the  other  hand,  it  is  computationally  tractable  and 
it  does  in  fact  yield  all  of  the  above  measures  of  effectiveness  as  pos¬ 
sible  outputs.  None  of  these  measures  is  amenable  to  "closed  form"  ana¬ 
lytical  evaluation.  Instead,  numerical  computation  of  formulae  is  em¬ 
ployed.  The  model  does  provide  illustrative  procedures  for  displaying 
how  these  measures  are  evaluated.  The  developments  in  this  approach 
were  motivated  by  the  doctoral  work  of  Dr.  Thomas  E,  Humphrey  of  Stanford 
Research  Institute,  on  multidimensional  Markov  processes  applied  to  queuing 
theory. ® 


A  Markov  model  for  the  single  unit  situation  is  obtainable  from 
the  following  procedure: 

(1)  Assign  a  separate  state  of  the  system  for  every  prob¬ 
abilistic  event  that  it  is  desired  to  distinguish  for 
the  desired  computations. 

(2)  Establish  the  transition  probabilities  from  one  state 
to  another  and  the  distributions  of  duration  in  the 
various  states. 

(3)  Establish  the  appropriate  semi-Markov  flow  diagram6 
created  by  the  resulting  embedded  continuous-time 
Markov  process  in  the  model. 

(4)  Calculate  the  "transmission"  (a  Laplace  transform) 
through  the  flow  diagram  between  the  input  and  output 
nodes  associated  with  the  desired  ensure  of  effec¬ 
tiveness.  This  is  likely  to  be  a  large,  but  not  in¬ 
feasible  computational  task  for  the  size  of  networks 
in  the  ASW  case.  Fortunately,  the  calculations  are 
suitable  foe  digital  computation. 

(5)  Calculate  the  inverse  Laplace  transform  of  the  "trans¬ 
mission"  in  4  above.  This  is  equal  to  the  cumulative 
distribution  function  of  the  quantities  specified  in 
the  measure  of  effectiveness. 
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For  present  computations,  a  numerical  integration  approach  was 
selected  based  upon  ease  of  implementation.  The  procedure  in  steps  4  and 
5  was  not  used  since  the  Laplace  transforms  resulting  from  the  very  large 
flow  graphs  involved  here  are  too  complex  to  treat  without  a  computer 
program  for  automatic  flow  graph  reduction.  Granted,  it  would  be  very 
illustrative  to  know  the  various  time  constants  of  the  model  (i.e,,  eigen¬ 
values  of  the  Markov  transition  matrix),  but  numerical  plots  of  the  prob¬ 
ability  distributions  corresponding  to  the  various  desired  measures  of 
effectiveness  are  a  suitable  form  of  the  desired  information  for  most 
purposes.  The  Laplace  transform  approach  has  not  been  totally  discarded, 
and  a  search  is  continuing  for  a  practical  method  of  solution  by  this 
means . 

B.  Detailed  Description  of  Unit  Model 

1.  Structure  of  the  Queuing  Situation  in  the  Unit  Model 

The  queuing  situation  to  be  studied  is  one  in  which  each  cus- 
tomer  is  subjected  to  multiple  phases  of  service  by  parallel  servers 
according  to  a  particular  discipline.  The  customer  may  be  required  to 
wait  between  service  phases  and/or  may  leave  before  completing  all  ser¬ 
vice  phases.^  The  methods  developed  are  not  limited  to  the  case  studied 
but  are  applicable  to  a  broad  class  of  queues  having  multiple  phases  of 
service  (single  or  multiple  servers)  and  various  service  disciplines, 
queue  disciplines,  and  arrival  behaviors.  Poisson  distributed  arrivals 
and  exponentially  distributed  service  phase  holding  times  are  assumed, 
but  the  approach  described  is  not  limited  to  these  distributions  alone. 


Section  IV-B  will  speak  of  a  contact  as  a  "customer."  This  is  a  very 
familiar  cerm  in  general  queuing  theory  and  is  more  illustrative  of 
the  "queuing"  concept  than  "contact.' 

This  corresponds  to  classification  as  a  non-sub  in  ASW  situation. 


As  pointed  out  at  the  end  of  Section  III-A-2,  it  is  possible  to  replace 
each  exponential  holding  time  by  a  subnetwork  of  holding  times  approxi¬ 
mating  any  desired  distribution.  The  queuing  situation  is  considered  to 
consist  of  an  arrival  process,  an  arrival  queue,  and  a  service  system. 

2.  The  Service  System 

The  queue  service  system  is  one  in  which  each  customer  is  sub¬ 
jected  to  successive  phases  of  service  at  a  sequence  of  service  stations 

according  to  a  specific  service  discipline.  The  service  stations  are 
arranged  into  a  sequence  of  service  stages,  as  shown  in  Figure  III-l, 

Each  stage  provides  one  phase  of  service.  The  customer  moves  from  stage 
to  stage  in  sequence,  without  repetition,  and  may  leave  the  service  sys¬ 
tem  after  completing  any  service  phase. 

A  customer  is  served  by  one  and  only  one  service  station  at 
each  stage.  Parallel  stations  allow  services  up  to  customers  at  stage 
k.  The  capacity  of  successive  stages  decreases,  i.e.,  s^+^  £  s^.  A  cus¬ 
tomer  completing  stage  k  service  may  find  no  service  stations  available 
at  stage  (k  +  1)  and  be  forced  to  join  a  stage  (k  +  1)  queue.  The  maximum 
length  of  the  stage  (k  +  1)  queue  is  s^  -  sj.+^-  The  stage  1  queue  accom¬ 
modates  customers  arriving  at  the  service  system  and  need  not  have  a  max¬ 

imum  length. 

A  station,  having  served  a  customer,  remains  dedicated  to  that 
customer  until  he  leaves  the  service  system.  A  customer  receiving  service 
at  stage  k  or  in  the  stage  (k  +  1)  queue  "ties  up"  one  service  station  in 
each  of  the  first  k  stages;  the  available  service  capacity  of  each  i  the 
first  k  stages  is  reduced  by  one.  W'nen  a  customer  leaves  the  service  sys¬ 
tem,  the  stations  that  were  dedicated  to  that  customer  ore  released  and 
become  available  to  serve  new  customers. 
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The  maximum  number  of  customers  that  can  be  in  the  service  sys 
tern  at  one  time  is  the  server  capacity  of  the  first  stage,  s^. 

3 .  Service  System  Notation 

Let  n^  be  the  number  of  service  stations  in  stage  k  that  are 
busy,  i.e.,  that  are  either  serving  customers  or  dedicated  to  customers 
elsewhere  in  the  service  system.  Let  qk  be  the  number  of  customers  in 
the  stage  k  queue.  From  the  description  of  service  system  behavior,  it 
follows  that: 


”k  *  Sk 


(III-B-1) 


q  =  0  if  n  <  s 

k  k  k 

0  *  qk  *  \_1  ~  \  if  \  =  sk 


(III-B-2) 


^  +  qk  ^  sk_1  for  k  >  1  .  (III-B-3) 


The  value  q^  describes  the  queue  of  arrivals  to  the  service  system  and 
need  not  have  a  limit.  The  value  n^  describes  both  the  number  of  busy 
stage  1  service  stations  and  the  total  number  oi  customers  being  served. 
The  remaining  stages  of  a  k-stage  service  system  may  be  characterized  by 
the  ordered  N- tuple 


§ 


n. 


k’  V  V 
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which  takes  a  finite  number  of  unique  values.  This  allows  the  values  of 
§  to  be  ordered  and  identified  by  integer  valued  state  numbers.  The  state 


* 


number  and  n^  together  describe  the  state  of  the  full  service  system.  The 
value  q-^  gives  the  length  of  the  arrival  queue.  The  three  numbers  together 
characterize  the  state  of  the  total  queuing  system.* 

A  more  compact  representation  is  possible.  The  total  number  of 
customers  utilizing  stage  k  service  stations  or  in  the  stage  k  queue  is 
given  by  the  sum: 


ck  ’  \  +  ,>lc  '  ( III-B-5) 

The  value  of  ck  can  be  decomposed  using  the  equations: 


n 


k 


q 


Jc 


lf  ck  a  sk 


otherwise 


if  c  £  s, 
k  k 


s,  otherwise 
k 
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The  total  queuing  system  can  be  fully  characterized  using  the  value  c-^ 
and  an  ordered  N-tuple  consisting  of  the  values  c9,  c3,  ...  ,  ck.  Such 


This  statement  implies  certain  assumptions  regarding  the  service  sta¬ 
tions  in  each  stage.  The  probability  of  completing  a  customer  service 
is  assumed  to  be  a  function  only  of  the  number  of  stations  currently 
serving  customers  and  is  independent  of  which  stations  are  supplying 
the  service.  When  the  probability  of  completing  a  service  is  dependent 
upon  which  stations  are  supplying  the  service,  a  description  of  the 
service  system  state  must  specifically  identify  each  busy  service  sta¬ 
tion  with  a  particular  customer.  The  service  discipline  must  specify 
the  rules  by  which  idle  service  stations  are  assigned  to  customers. 

This  is  certainly  possible  using  the  methods  developed  here,  but  the 
number  of  unique  service  system  stages  is  greatly  increased. 
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N-tuples  can  be  arranged  in  a  one-to-one  correspondence  with  the  $  ordering 
and  assigned  the  same  state  numbers.  The  state  of  the  total  queuing  system 
can  thus  be  characterized  by  c-^  or  the  pair  of  values  (Np  q^),  together 
with  either  the  N-tuple  §,  the  N-tuple  of  c^'s,  or  the  service  system  state 
number . 

For  mathematical  formulations  of  queuing  system  models,  and  where 
concise  notation  is  required,  the  value  Cp  together  with  the  state  number 
is  most  convenient,  and  will  be  represented  by  the  notation  (c  ,  x). 

For  graphical  representations  of  service  system  state  transi¬ 
tions,  the  n-^  and  q-^  values  and  the  N-tuple  §  will  be  used  since  this  makes 
the  system  state  highly  visible.  The  values  will  be  portrayed  as  shown  in 
Figures  III-3a  and  III-3b.  The  Figure  III-3a  representation  is  used  only 
when  all  queues  in  the  system  are  empty.  The  concise  notation  (Cp  x) 


FIGURE  1 1 1-3  GRAPHICAL  QUEUING  SYSTEM  STATE 
REPRESENTATIONS 


will  be  shown,  where  possible,  immediately  below  the  graphical  represen¬ 
tation  to  identify  the  corresponding  state  number  assignment. 


4 .  A  Simplified  Specific  Service  System  for  Initial  Analysis  and 

Example  Computation 

Discussions  in  this  and  subsequent  sections  are  in  terms  of  the 
particular  service  system  configuration  shown  in  Figure  III-l.  The  ten 
service  stations  are  arranged  to  provide  four  phases  of  service.  A  max¬ 
imum  of  four  customers  can  be  accommodated  by  the  service  system  at  one 
time.  The  queue  preceding  stage  1 — the  arrival  queue — is  of  indefinite 
length.  There  are  four  service  stations  for  stage  1,  three  for  stage  2, 
two  for  stage  3,  and  one  for  stage  4.  The  queues  preceding  stages  2,  3, 
and  4  each  have  maximum  length  one.  This  service  system  is  readily  gen¬ 
eralized  to  service  systems  having  different  numbers  of  service  stages 
and/or  service  stations  at  each  stage. 

It  is  assumed  that  all  service  stations  in  a  stage  are  indis¬ 
tinguishable.  A  service  station  in  stage  k  is  assumed  to  have  an  expo¬ 
nentially  distributed  holding  time  with  mean  value  Thus  if  rri|.  is  the 

number  of  stations  serving  customers  in  stage  k,  the  probability  that  one 
of  the  stations  will  complete  service  in  an  interval  of  length  dt  is  equal 
to  m^p^dt.  Note  that  m^  =  n^  only  for  the  last  stage  in  the  service  sys¬ 
tem,  and  is  given  by 

"V-  =  \  "  \+l  "  qk+i  (III-B-8) 


for  all  other  stages.* 


It  is  possible  to  make  service  completion  probability  a  function  of 
any  or  all  of  the  values  mk,  nk,  and  qk  to  model  situations  in  which 
server  activity  varies  with  customer  load. 
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In  the  interval  dt,  one  and  only  one  service  station  may  com¬ 
plete  service  and  produce  a  state  transition.  That  is,  station  service 
completions  are  considered  to  be  independent,  mutually  exclusive  events. 
When  a  service  completion  results  in  a  customer’s  leaving  the  service 
system,*  however,  all  service  stations  previously  dedicated  to  that  cus¬ 
tomer  are  freed  to  accept  new  customers.  When  such  a  transition  occurs, 
a  customer  in  a  queue  is  allowed  tc  begin  service  immediately.  Thus  any 
single  sei’vice  completion  in  which  a  customer  leaves  the  service  system 
causes  transition  to  a  state  in  which  all  interim  queues — i.e.,  those 
queues  associated  with  stages  2,  3,  and  4 — are  emptied  and  the  arrival 
queue,  if  nonzero,  is  reduced  by  one.  New  customers  enter  service  sta¬ 
tions  freed  by  a  departing  customer  simultaneously  with  the  customer  de¬ 
parture  from  the  service  system.  While  this  represents  a  compound  real- 
location  of  service  station  resources,  it  results  from  a  single  station 
service  completion.  Compound  state  transitions  corresponding  to  comple¬ 
tion  of  more  than  one  station's  service  in  an  interval  of  length  dt  do 
not  occur. 

State  numbering  is  such  that  in  transitions  of  the  form 
(c-^,  X)  -*  (c^,  Y)  it  is  always  the  case  that  Y  >  X.  Further,  the  numbers 
(X  and  Y)  are  assigned  s*.  that  the  four  states  occurring  with  one  customer 
in  the  system  are  numbered  1  to  4,  the  ten  states  occurring  with  two  cus¬ 
tomers  in  the  system  are  numbered  1  to  10,  the  19  states  occurring  with 
three  customers  in  the  system  are  numbered  1  to  19,  and  the  28  states 
occurring  witli  four  or  more  customers  are  numbered  1  to  28.  These  con¬ 
ventions  simplify  the  task  of  relating  the  graphical  representations  to 
mathematical  formulations  of  the  model.  In  other  respects  the  state 


The  simplified  system  here  allows  customers  to  leave  the  entire  system 
only  after  the  4-th  stage  of  service.  Modeling  of  classification  and 
hand-offs  is  nevertheless  possible  by  reverting  to  a  more  general  sit¬ 
uation,  as  described  prior  to  this  subsection. 
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number  assignments  are  arbitrary.  Figures  III-4  through  III-8  identify 
and  number  the  states  and  graphically  describe  state  transitions  for  the 
service  system  configuration  of  Figure  III-3.  Three  cases  are  identified: 
the  idle  server  system,  the  busy  service  system,  and  the  saturated  service 
system. 

The  service  system  is  idle  when  no  customers  are  present.  The 
single  system  state  is  represented  in  Figure  III-4.  No  service  system 
state  transitions  occur  when  the  service  system  is  idle, 

A  busy  service  system  results  when  one,  two,  or  three  customers 
are  present.  The  service  system  states  are  identified  and  numbered,  and 
state  transitions  are  represented  graphically  for  these  three  conditions 
in  Figures  III-5,  III-6,  and  III-7,  respectively.  For  each  state  the  c^ 
value  and  state  number  assignment  are  shown  in  the  notation  (c^,  X)  im¬ 
mediately  below  the  state  representation;  service  system  states  resulting 
from  customers  leaving  the  service  system  are  also  shown  in  this  notation. 
Transitions  representing  customers  leaving  the  system  are  shown  only  for 
stage  4  service  completions.  Associated  with  each  arrow  describing  a 
state  transition  is  a  coefficient.  This  coefficient,  when  multiplied  by 
dt,  gives  the  probability  that  the  transition  will  be  made  in  an  interval 
of  length  dt.  Note  that  contention  for  service  station  resources  results 
as  soon  as  two  or  more  customers  are  in  the  service  system,  producing  sys¬ 
tem  states  having  interim  queues  (Figures  II 1-5  and  III-6),  For  defini¬ 
tional  purposes,  an  "unsaturated"  system  is  one  which  is  either  idle 
(empty)  or  busy. 

A  saturated  service  system  results  when  four  or  more  customers 
are  present.  Because  of  the  large  number  of  possible  service  system  states 
(28)  in  this  case,  the  graphical  representation  of  service  system  state 
transitions  is  in  two  parts:  Figure  III-8a  describes  service  system  states 
that  exist  when  no  interim  queues  are  present;  Figure  III-8b  describes 
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FIGURE  III-4  SERVICE  SYSTEM  STATE 
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FIGURE  III-5  SERVICE  SYSTEM  STATES  WITH  ONE  CUSTOMER  PRESENT 
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FIGURE  Ill-Sa  SERVICE  SYSTEM  STATES 
WITH  FOUR  CUSTOMERS 
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service  system  states  that  occur  when  there  is  contention  for  service 
stations  and  interim  queues  exist  preceding  states  2,  3,  and/or  4.  Tran¬ 
sitions  between  states  are  represented  by  arrows  with  associated  probabil¬ 
ity  coefficients.  Figure  III-8a  shows  transitions  to  Figure  III-8b  states, 
and  Figure  III-8b  shows  the  Figure  III-8a  states  from  which  transitions  to 
Figure  III-8b  states  are  made.  Transitions  corresponding  to  customers 
leaving  the  service  system  are  shown  only  for  stage  4  service  completions. 
The  concise  state  notation  (C,  X)  is  used  where  C  =  c  ,  and  X  is  the  state 
number  assignment.  When  a  customer  leaves  the  system  a  transition  of  the 
form  (C,  X)  -*  (C-l,  Y)  occurs.  When  C  =  4  the  transition  is  from  stare  X 
in  Figure  III-8a  or  III-8b  to  some  state  Y  in  Figure  IxI-7.  When  C  >  4, 
however,  the  transition  is  to  some  state  Y  in  Figure  III-8a,  and  the  num¬ 
ber  of  customers  being  served  remains  the  same,  but  the  arrival  queue  is 
reduced  by  one. 

C.  Flow  Graphs  for  Statistical  Factor  Calculation 
1 .  Steady  State  Model 

Calculation  of  the  steady  state  (equilibrium)  probabilities 
for  the  occupancies  of  various  states  of  the  system  described  by  Figures 
III-4  through  III-8  is  required  for  subsequent  analyses.  Recall  that  the 
various  states  have  to  do  with  how  many  contacts  are  in  each  part  of  the 
system.  The  steady  state  probabilities  are  then  mathematical  statements 
of  the  likelihoods  of  varying  degrees  of  load  and  overload  on  the  ASW'  unit 
functions . 

Flow  grapn  techniques  are  employed  to  calculate  these  probabili¬ 
ties.  Flow  graphs  can  be  thought  of  as  networks  of  nodes  and  arcs  through 
which  "probabilities"  of  certain  events  "flow."  In  a  sense  the  nodes  and 
arcs  affect  these  flows  in  a  manner  analogous  to  the  way  contacts  "flow" 
through  the  element  queuing  model.  By  properly  selecting  the  transmission 


characteristics  of  the  network,  the  transmission  through  the  network  is 
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made  to  be  numerically  equal  to  the  desired  probability.  ’  Motivation 
for  and  development  of  flow  graph  techniques  and  computational  methods 
is  provided  in  Appendix  A. 

The  steady  state  (equilibrium)  probabilities  for  the  various 
states  of  the  queuing  model  described  in  the  previous  section  are  obtain¬ 
able  from  the  flow  graph  shown  in  matrix  form  in  Figure  III-9,  which  com¬ 
bines  the  diagrams,  with  certain  modifications,  of  Figures  III-4  through 
III-8.  One  of  the  modifications  involves  the  diagram  of  Figure  III-8. 

To  form  a  complete  flow  graph  the  diagram  of  Figure  III-8  must  be  repli¬ 
cated  as  often  as  is  necessary  to  account  for  various  possible  numbers 
of  contacts  in  the  first  queue  (ahead  of  detection).  Theoretically,  there 
could  be  an  infinite  number  of  contacts  in  queue,  but  practical  solutions 
are  attainable  only  with  a  finitely  terminated  flow  graph.  There  are  two 
practical  ways  to  terminate  the  flow  graph.  One  is  to  assume  a  large  but 
finite  population  of  contacts  and  simply  ignore  all  arrivals  after  a  cer¬ 
tain  number  of  contacts  enter  the  queue.  This  case  is  illustrated  in 
Figure  III-10.  Since,  under  quite  liberal  conditions,  the  probabilities 
associated  with  very  large  queue  occupancies  are  small,  the  assumption  of 
a  finite  population  has  a  very  minor  effect  on  the  system's  queuing  statis¬ 
tics.  The  second  method  of  terminating  the  flow  graph  is  to  "fold”  the 
infinite  flow  graph  as  illustrated  in  Figure  III-ll.  A  mathematical  ar¬ 
tifice  is  employed,  and  no  assumptions  of  finiteness  are  necessitated. 

Some  complexity  is  added  to  the  computation. 

The  flow  graphs  in  Figures  III-9  to  III-ll  have  the  same  graphi¬ 
cal  structure  (i.e.,  node-arc  incidence  properties)  os  the  transition  rate 
diagrams  in  Figures  III-4  to  I I 1—8,  but  the  arc  flow  factors  in  Figures 
III-9  to  III-ll  are  the  p.  ,'s  of  the  corresponding  Markov  process,  as 
explained  in  Appendix  A. 
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FIGURE  111-11  "FOLDED"  INFINITE  CHAIN  IN  STEADY-STATE  FLOW  GRAPH 


The  vector  nodes  in  Figures  III-9  to  II 1-11  correspond  to  the 
blocks  of  states  having  0,  1,  2,  ...  contacts  in  the  system.  The  0  state 
is  a  scalar  state  only.  The  matrices  U^,  and  contain  transition 
probabilities  of  the  form 
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A+cl  +  n  +  u  +u 
^2  ^3  ^4 


etc.,  (III-C-1) 


corresponding  to  the  appropriate  service  and  arrival  transitions  in  Fig¬ 
ures  II 1-4  to  III-8.  Note  that  these  matrices  repeat  after  a  certain 
stage.  Their  internal  structure,  using  the  node  labels  of  Figures  I I 1—4 
to  III-8,  is  obtainable  by  expressing  the  node  to  node  incidence  relations 
for  the  graphs  in  these  figures.  This  was  done  for  the  computer  programs 
described  in  Section  III-D. 


The  "folded"  infinite  chain  in  Figure  III-ll  requires  some  ex¬ 
planation.  In  flow  graph  applications  there  is  often  an  infinite  chain 
of  repeating  identical  subgraphs.  For  example,  the  simple  "birth-death" 
type  of  process,  i.e.,  a  Poisson  queue,  has  a  flow  graph  as  in  Figure 
III-9,  but  with  all  A's,  U's,  and  O' s  being  scalars  and  given  by  the  fol¬ 
lowing  expressions: 


"folding 
and  arcs 


Q 


,  a 

A  +  p  i 


=  0  i  =  1,2, 


a.  =  rr~  ’  1 

i.  A  +  p 


=  0,1,2, 


( III-C-2) 


U. 


*  t 

A  +  p 


i  =  1,2, 


over  amounts  to  equating  the  effect  of  the  remainder  of  all  nodes 
in  an  infinite  flow  graph  past  a  certain  point  to  a  single  self- 
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loop  with  factor  0.  To  determine  the  value  of  Q  in  this  scalar  case,  we 
calculate  it  from  the  relation  between  0  and  the  other  problem  parameters 
in  Figure  III-12,  which  expresses  the  fact  that  the  infinite  "tail"  with 


\/(k  +  fl)  SI 


FIGURE  III-12  CALCULATION  OF  INFINITE  “TAIL"  VALUE  IN  A  FLOW  GRAPH 

one  more  repeating  item  attached  is  the  same  as  the  "tail"  itself.  But 
the  flow  graph  on  the  left  side  of  Figure  III-12  can  be  reduced  (by  stan- 

g 

dard  flow  graph  reduction  methods  )  to  a  self-loop  having  a  transmission 
equal  to: 


O’  = 


(1-0)  (Up) 


(III-C-3) 


Thus  we  have 


Q  =  Q'  = 


(1-0)  (X+p) 


(III-C-4) 


which  yields 


0  = 


1  ±  y/l  -  4Xp/(X+p)3 


X  +  u  ±  lX-p 
2  (X+p) 


X 

X+p 

Ji_ 

X+p 


(III-C-5) 


This  results  in  two  possible  solutions  lor  Q  in  the  interval  (0,1).  It 
will  be  observed  that  taking  Q  =  X/(X+p)  leads  to  a  consistent  set  of 
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steady  state  equations,  i.e.,  the  finite  P  matrix  arising  from  the  trun¬ 
cated  network  of  Figure  III-ll  (with  scalar  nodes  and  arcs  for  a  birth- 
death  process)  is  stochastic,  whereas  taking  Q  =  |i/(X+p,)  leads  to  an  in¬ 
consistent  set  of  equations.  It  can  also  be  shown  that  the  birth-death 
process  is  stable  only  when  X  <  p,. 

In  the  general  cast  of  Figure  III-ll,  the  "folding"  process 
yields  the  matrix  equation: 

Cl  =  Cl  +  U  (I-Q)"1  A.  .  (III-C-6) 

4  5  4 

When  />4  is  a  diagonal  matrix  with  a  uniform  constant  X  running  down  the 
diagonal,  as  is  the  case  in  the  single  unit  model,  this  simplifies  to  the 
matrix  quadratic  equation 


C?  -  (I+Q  )fi  +  Q  +  XU  =  0  ,  (III-C-7) 

4  fx  D 

for  which  it  is  possible  to  iterate  towards  a  solution  matrix  Q.  The 
convergence  of  certain  iterative  procedures  to  solve  the  above  equation 
was  considered,  but  this  approach  has  not  been  used  to  date. 

One  potential  disadvantage  of  "folding"  may  appear  to  be  that 
a  full  matrix  Cl  is  created  out  of  the  very  sparse  matrices  Ug,  and 
/vj ,  because  of  the  inversion  process  (or,  equivalently,  solving  of  the 
quadratic  equation).  Thus,  whereas  at  most  five  multiplications  per  equa¬ 
tion  are  required  (as  shown  in  Section  III-D)  per  iteration  in  solving 
for  the  steady  state  probabilities,  the  greater  number  of  28  operations 
per  equation  would  be  required  using  the  "folded"  Q.  However,  using  Cl 
allows  one  to  drop  all  states  of  the  flow  graph  past  some  desired  trun¬ 
cation  point  without  losing  accuracy  in  the  probabilities  calculated  for 
the  flow  graph  up  to  that  point.  Truncating  without  folding,  as  in 
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Figure  III-10,  requires  going  very  far  out  on  the  flow  graph  so  that  any 
remaining  neglected  state  probabilities  would  be  negligible.  This  "fold¬ 
ing”  approach  may  be  considered  in  future  applications  but,  for  present 
purposes,  it  has  been  found  that  adequate  accuracy  with  acceptable  compu¬ 
tation  requirements  is  obtained  with  the  simpler  truncation  method. 

2.  System  Unsaturated  Time 

As  explained  in  Appendix  A,  Section  6,  probability  distributions 
for  the  time  a  Markov  or  semi-Markov  process  spends  in  any  given  subset 
of  its  states  is  obtainable,  in  terms  of  Laplace  transforms,  by  suitably 
modifying  the  semi-Markov  type  of  flow  graph  for  the  process.  The  present 
system  is  "unsaturated, "  by  definition,  when  not  all  the  sonar  servers  are 
occupied,  and  therefore  new  detections  are  possible.  This  means  that  the 
appropriate  subset  S  of  nodes  in  the  flow  graph  to  be  considered  should 
be  all  nodes  corresponding  to  0,  1,  2,  or  3  contacts  in  the  system.  The 
desired  probability  that  the  system  spends  at  least  time  t  in  states  0, 

1,  2,  3,  is  therefore  the  inverse  Laplace  transform  of  the  transmission 
from  input  to  output  for  a  suitably  modified  flow  graph,  as  explained  in 
Appendix  A.  The  appropriate  flow  graph  for  computing  this  for  unsaturated 
time  is  given  in  Figure  III-13  in  matrix  form.  For  the  sake  of  simplicity 
the  complete  detailed  flow  graph  for  Figure  I I 1-13  is  not  shown.  The  de¬ 
tails  of  the  particular  subgraphs  used  for  1,  2,  3,  and  4  or  more  contacts 


FIGURE  III— 1 3  UNSATURATED  TIME  MATRIX  FLOW  GRAPH 
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in  the  system  are  given  in  Figures  III-4  to  III-8  in  structural  form,  that 
is.  with  transition  rates  along  the  arcs  and  not  the  Laplace  transforms 
needed  in  the  semi-Markov  flow  graph.  Figures  A-8a,  A-9a,  and  A-9b  in 
Appendix  A  illustrate  the  form  of  the  Laplace  transforms. 

The  matrix  in  Figure  III-13  is  obtained  by  replacing  each 
nonzero  Laplace  transform  entry  in  by  an  appropriate  steady  state  prob¬ 
ability  and  "compressing"  this  new  matrix  down  to  a  column  vector.  The 

matrix  A'  is  just  A„  "compressed"  to  a  row  vector.  This  "compressing"  is 
3  3 

all  that  is  necessary  since  every  substate  for  n  contacts  in  the  system 
of  the  model  connects  to  at  most  one  substate  for  n-1  or  n+1  contacts  in 
the  system.  If  there  had  been  more  than  one  possible  transition  to  n-1 
or  n+1  contacts,  it  would  be  necessary  to  sum  all  transition  terms  in  or 
out  of  a  node  in  forming  Ag  and  U^. 

Although  in  principle  the  inverse  Laplace  transform  of  the  trans¬ 
mission  from  input  to  output  for  Figure  III-13  can  be  calculated,  it  was 
deemed  simpler  to  solve  the  associated  linear  system  of  differential  equa¬ 
tions.  This  is  discussed  further  in  Sections  III-D  and  III-E, 

If  it  is  desired  to  calculate  the  probability  density  function 
for  unsaturated  time,  it  suffices  to  omit  the  1/s  factors  on  the  output 
arcs  of  Figure  I I 1-13  (as  pointed  out  in  general  in  Appendix  A). 

3 .  System  Saturated  Time 

In  a  manner  similar  to  that  employed  to  determine  the  distribu¬ 
tion  of  system  unsaturated  time,  an  appropriate  modification  of  the  semi- 
Markov  flow  graph  of  the  model  is  formed  for  saturated  time.  In  this 
case  only  states  corresponding  to  4  or  more  contacts  in  the  system  are 
used.  Unfortunately,  in  this  case  we  have  the  infinite  flow  graph  of 
Figure  III-14.  Here  Ag  and  U”  play  reverse  roles  of  their  counterparts 
Ag  and  in  Figure  III-13.  That  is,  Ag  now  is  a  column  vector  of  nor¬ 
malized  steady  state  probabilities,  and  U^'  now  is  a  row  vector  having 


FIGURE  III-14  SATURATED  TIME  MATRIX  FLOW  GRAPH 

components  l/(s  (s+p.^ ) )  in  certain  columns  corresponding  to  contacts  leaving 
the  system. 

Since  the  above  flow  graph  is  infinite,  there  are  various  ways 
to  proceed.  One  way  is  to  "fold"  the  flow  graph  and  invert  the  resultant 
Laplace  transform.  Unfortunately,  folding  in  this  case  leads  to  a  rather 
complicated  irrational  Laplace  transform,  i.e.,  involving  numerous  square 
roots  of  many  rational  terms.  This  leads  to  complicated  combinations  of 
Bessel  functions,  in  fact,  an  infinite  series  of  Bessel  functions,  for 
the  inverse  transform.  Thus  only  an  approximate  solution  can  be  obtained, 
even  though  the  exact  Laplace  transform  is  known.  Howard6  has  used  this 
approach  successfully  on  relatively  small  problems.  It  may  be  more  ef¬ 
ficient,  from  the  numerical  computation  standpoint,  to  truncate  the  flow 
graph  at  some  suitable  stage  and  solve  a  finite  system  of  constant  coef¬ 
ficient  linear  differential  equations.  An  alternative  would  be  not  to 
truncate  but  formulate  the  equivalent  time  dependent  coefficient  linear 
equations  or  integral  equations  that  arise  in  situations  like  this,  '•"d 
solve  these  by  numerical  integration.  For  ease  of  implementation,  trun¬ 
cation  of  the  flow  graph  was  employed  to  derive  the  illustrative  results. 

4 .  Waiting  Time 

To  calculate  a  distribution  for  the  time  a  contact  must  wait 
in  the  first  queue  (detection  queue),  it  is  necessary  to  go  beyond  just 
taking  subsets  of  the  total  set  of  states  of  the  system.  The  progress 
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of  a  specific  contact  must  be  considered  and  not  just  the  state  of  the 
total  system.  To  the  extent  that  the  waiting  of  a  contact  involves  the 
system's  having  5  or  more  contacts  in  it,  the  subset  of  states  with  5  or 
more  contacts  is  in  fact  going  to  be  considered,  but  the  transition  rates 
between  these  states  have  to  be  modified  to  reflect  the  service  priority 
that  is  established.  For  this  purpose  all  stimuli  awaiting  detection  are 
assumed  to  be  equally  likely  to  be  detected  by  the  sonar.  If  a  first- 
come-f irst-served  policy  had  been  chosen  as  a  service  priority  for  the 
waiting  stimuli,  as  is  common  in  many  queuing  models,  the  mathematics  of 
the  waiting  time  model  would  be  simpler — at  the  expense  of  considerably 
more  complexity  in  the  time-in-system  model  of  the  next  section.  For  this 
reason  random  selection  of  stimuli  for  detection  was  assumed. 

On  the  basis  of  random  selection  from  the  first  queue,  a  sonar 
stimulus  has  a  probability  of  1/n  for  being  detected.  The  probability 
that  some  other  sonar  stimulus  is  detected  is  (n-l)/n,  given  that  the 
system  is  in  the  process  of  detecting.  The  correct  flow  graph  modifica¬ 
tion  to  represent  this  phenomenon  is  given  in  Figure  III-15.  The  matrices 
Ug  in  Figure  1 1 1—15  are  copies  of  the  matrix  Ug  compressed  Jo  a  row  vector 
(and  multiplied  by  1/s  if  the  cumulative  distribution  is  desired).  The 
matrix  Ug  is  understood  to  contain  the  necessary  semi -Markov  flow  graph 
terms  of  the  type  u^j/(s+X+.  .  ,+p,^ ) ,  just  as  in  the  previous  two  cases. 

The  matrices  A£,  Ag,  ...  are  structurally  all  identical,  i.e.,  copies  of 
the  /7j  compressed  to  a  column  vector  and  having  nonzero  entries  only  at 
the  same  rows  as  A^ .  These  entries  ar-  now  required  to  be  the  steady 
state  probabilities  for  the  corresponding  substates  for  n  in  the  system, 
etc.,  instead  of  the  terms  X/(s+X+. . . )  used  in  forming  A^ . 

As  in  the  case  of  system  saturated  time,  the  flow  graph  for 
waiting  time  is  infinite,  and  one  can  either  truncate  it  or  attempt  to 
fold  it  over  into  an  equivalent  finite  flow  graph.  Folding  has  not  been 
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FIGURE  III-15  WAITING  TIME  FLOW  GRAPH  FOR  RANDOM 
SELECTION  FROM  STIMULUS  QUEUE 


fully  investigated  in  this  case  thus  far.  In  the  case  of  the  first-come- 
first-served  priority  policy,  for  which  the  flow  graph  of  Figure  I 11-16 
was  obtained,  folding  is  facilitated  by  the  ability  to  establish  first 
the  equivalent  repetitive  flow  graph  of  Figure  III-17.  A  similar  devel¬ 
opment  for  the  random  priority  policy  was  investigated,  but  this  approach 
was  deemed  unlikely  to  lead  to  more  efficient  numerical  solution.  As 
with  system  saturated  time,  truncation  of  the  flow  graph  was  employed, 

5.  Time  In  System 

The  most  complex  flow  graph  for  the  unit  model  arises  in  the 
case  of  calculating  the  probability  distribution  for  time  in  the  system 
spent  by  any  one  specified  contact.  This  is  a  useful  measure  from  the 
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point  of  view  of  determining  whether  the  ASW  platform  is  capable  of  deal¬ 
ing  with  the  contact  prior  to  its  approaching  the  platform  "too  close  for 
comfort."  The  other  measures  above  are  more  related  to  how  well  the  ASW 
platform  functions,  where  any  bottlenecks  might  be,  etc.  They  are  also 
useful  in  a  more  involved  model  for  target/ASW  platform  interaction,  which 
is  the  subject  of  the  other  principal  area  of  investigation  on  this  proj¬ 
ect,  viz.,  the  force  effectiveness  model  development. 

A  suitable  flow  graph  for  computing  the  Laplace  transform  of 
the  probability  that  a  given  contact  spends  time  t  or  less  in  the  system 
may  be  derived  as  follows.  As  in  the  case  of  waiting  time,  the  progress 
of  a  specific  contact  must  be  taken  into  consideration.  Essentially,  a 
Markov  process  is  created  with  trapping  states  placed  in  such  a  way  that, 
no  matter  what  is  happening  to  other  contacts,  process  termination  occurs 
only  at  states  that  correspond  to  the  specified  contact  exiting  the  sys¬ 
tem.  This  is  complicated  because  contacts  can  pass  each  other  in  the 
model.  In  order  to  represent  all  possible  states  of  the  system  relative 
to  what  the  specified  contact  is  doing,  the  dimension  of  the  states  must 
be  compounded.  That  is,  for  every  actual  state  of  the  model  we  must  con¬ 
sider  as  many  alternatives  as  there  are  possible  positions  of  the  speci¬ 
fied  contact  allowed  by  that  state.  The  highest  number  of  alternatives 
that  will  ever  appear  is  4,  when  there  are  no  contacts  in  the  primary 
(detection)  queue,  since  there  arc  at  most  4  places  (out  of  the  less  than 
or  equal  to  4  contact  positions)  that  the  specified  contact  could  be. 

When  contacts  queue  up  ahead  of  the  detection  server,  the  random  selection 
policy  eliminates  the  need  to  keep  track  of  where  the  specified  contact 
is  in  the  queue.  With  a  f irst-come-f irst-served  policy  in  the  detection 
queue,  the  situation  becomes  still  more  complicated.  With  random  selec¬ 
tion,  there  is  the  possibility  of  contacts  passing  each  other  both  in  the 
first  queue  and  farther  on  in  the  system,  because  of  the  multiple  service 
channels  at  three  of  the  four  stages  of  service.  Theoretically  at  least, 
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an  infinite  number  of  contacts  that  arrive  after  a  given  contact  could 
possibly  pass  it  before  it  gets  out  of  the  system,  although  this  fact  is 
primarily  of  academic  interest  only.  Nevertheless,  even  for  computational 
purposes,  the  above  considerations  must  be  taken  into  account  or  else  a 
loss  of  accuracy  results. 

As  in  the  case  of  steady  state  calculations,  folding  is  neces¬ 
sary  to  maintain  accuracy  in  a  truncated  flow  graph  when  the  probability 
of  the  system's  being  in  any  of  the  neglected  states  is  not  negligible. 

In  the  present  case  folding  seems  to  be  even  more  difficult  than  in  the 
case  of  the  waiting  time  distribution. 

Returning  to  the  derivation  of  the  flow  graph,  let  us  define 
copies  i^,  i^,  ...  of  a  given  state  i,  using  notation  of  Figures  III-4 
to  III-8  for  the  description  of  a  state.  We  define  the  copy  i  to  repre- 

cl 

sent  the  given  contact  being  in  the  first  available  position  it  could  be 
in  for  state  i,  counting  from  the  top  down  and  from  the  left  to  the  right 
in  Figures  III-4  to  III-8,  Thus,  for  example,  state  52  from  Figure  III-8b 
will  nave  the  four  copies  in  Figure  III-18,  Note  that  only  one  contact 
can  be  in  each  of  the  3  queues  after  the  first,  so  no  subdivision  is  nec¬ 
essary  to  indicate  where  in  the  queue  a  contact  lies.  The  circles  in 
Figure  III-18  denote  the  specified  contact's  position.  Partial  details 
of  the  resultant  transition  rate  diagrams  for  2,  3,  and  4  contacts  in  the 


FIGURE  III-18  THE  FOUR  COPIES  OF  STATE  52  OF  FIGURE  III~8b  WITH  POSITION 
OF  SPECIFIED  CONTACT  DESIGNATED 
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system  are  given  in  Figures  III-19  to  III-21.  As  a  result,  when  comparing 
the  time -in -the -system  model  to  other  measure  of  effectiveness  models, 
there  is  a  greatly  increased  number  of  slates  for  each  number  of  contacts 
in  the  system.  The  magnitude  of  this  increase  is  indicated  in  Table  III-l. 


Table  III-l 

NUMBERS  OF  STATES  IN  SUBGRAPHS 
FOR  GIVEN  NUMBER  OF  CONTACTS  IN  SYSTEM 


No.  States  in  Subgraph 

No.  Contacts  in  System 

Time  in  System  Model 

Other  Models 

0 

1 

1 

1 

4 

4 

2 

17 

10 

3 

44 

19 

4  or  more 

83 

28 

Totals  for  up 
to  4  in  system 

149 

62 

The  already  large  number  of  149  of  states  for  just  up  to  4  con¬ 
tacts  in  the  system  is  only  the  beginning.  Next  must  be  added  an  infinite 
array  of  copies  of  the  subgraph  of  Figure  I 11-21  to  represent  the  various 
cases  where  the  singled  out  contact  is  in  service  while  particular  numbers 
oi  other  arrivals  are  in  queue,  since  it  matters  whether  others  are  in 
queue  and  how  many  are.  This  is  because  the  emptying  or  nonemptying  of 
the  queue  affects  the  singled  out  contact's  competition  for  service.  Thus, 
if  the  particular  contact  gets  into  service  when  there  are  a  great  many 
in  queue,  this  leads  to  a  higher  probability  of  its  being  passed  more 
limes  and  therefore  encountering  blocked  servers  more  often  than  if  there 
were  fewer  competitors.  Finally,  the  waiting  time  flow  graph  must  be 
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appended  to  the  time- in-system  flow  graph  to  represent  the  cases  where 
the  contact  is  in  queue  along  with  other  contacts.  To  accomplish  this, 
the  waiting  time  flow  graph's  output  arcs  are  connected  to  appropriate 
points  in  the  time-in-system  graph,  corresponding  to  the  singled  out  con¬ 
tact  going  into  service  with  particular  numbers  of  other  contacts  still 
left  in  the  queue.  The  final  result  is  the  matrix  flow  graph  of  Figure 
I 11-22.  Note  that  there  is  no  zero  node  since  a  contact  does  not  spend 
time  in  the  system  with  zero  contacts  in  it. 

The  double  circled  vector  nodes  in  Figure  I 11-22  represent  the 
full  extensions  of  Figures  III-19  to  III-21;  that  is,  these  nodes  corre¬ 
spond  to  the  singled  out  contact's  being  in  service  with  a  total  number 
of  2,  3,  or  4  contacts  in  the  system.  The  modified  transition  matrices 
A^,  U!,  0!,,  and  reflect  the  necessary  changes  that  must  be  made  in  the 
structure  of  the  semi-Markov  process  to  allow  it  to  transit  between  states 
where  the  specified  contact  is  competing  in  service  and  states  of  the  un¬ 
modified  Figures  III-8a  and  III-8b  are  represented  by  the  single  circled 
nodes  of  the  waiting  time  section  of  the  flow  graph.  The  "prime"  notation 
indicates  that  these  matrices  are  variations  on  the  original  ones.  Their 
detailed  structure  is  rather  complicated  and  is  not  given  here,  but  is 
easily  derivable  once  an  indexing  scheme  for  the  states  is  established. 

D.  Computational  Approaches  and  Sample  Solutions 
1 .  Steady  State  (Equilibrium)  Distributions 

The  steady  state  distribution  for  the  single  element  model  trun¬ 
cated  at  various  numbers  of  contacts  in  the  system  was  calculated  for 
several  values  of  arrival  rate  X  and  a  fixed  set  of  service  rates  to 
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FIGURE  III— 1 9  DETAILED  DIAGRAM  FOR  TWO 

IN  SYSTEM  WITH  POSITION  OF 
SPECIFIED  CONTACT  DESIGNATED 


FIGURE  111-20  PARTIAL  DETAILS  OF  DIAGRAM  FOR  THREE  IN  SYSTEM  WITH 
POSITION  OF  SPECIFIED  CONTACT  DESIGNATED 
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FLOW  GRAPH 


t-L j .  The  resulting  distributions  are  presented  in  Figures  111-23  and 
III-24.  Figure  III-23  clearly  shows  the  need  to  include  the  possibility 
of  a  large  number  of  contacts  in  the  system  before  acceptable  accuracy 
is  obtained.  As  mentioned  earlier,  this  could  be  avoided  by  folding, 
but  application  of  the  folding  approach  was  not  completed  at  the  time  of 
writing  of  this  report. 

The  interpretation  of  Figures  I I 1-23  and  I I 1-24  in  ASW  terms  is 
as  follows  (the  parameter  values  chosen  for  these  illustrative  computations 
are  hypothetical).  Figure  III-23  shows  the  likelihood  of  finding  a  par¬ 
ticular  number  of  contacts  in  process  in  the  system,  given  particular 
average  contact  arrival  and  service  times.  Thus,  for  an  average  rate  of 
5  contacts  per  hour  with  (fictitious)  detection,  localization,  attack, 
and  kill  times  (mean  values)  of  1  minute,  4  minutes,  12  minutes,  and  5 
minutes,  respectively,  the  most  likely  number  of  contacts  in  the  system 
at  one  time  is  3.  The  probability  of  a  peak  load  of  more  than  5  is  about 
1/3.  More  than  5  in  the  system  corresponds  to  2  or  more  r outlets  "in 
queue"  awaiting  detection — an  expression  of  a  degree  of  ov,'r.’  ading  of 
the  ASW  system  unit.  The  several  curves  in  this  figure  are  th  several 
approximations  co  the  exact  probability  curve.  Figure  III-24  slows  how 
system  load  (number  of  contacts  in  the  system)  varies  with  increasing 
contact  arrival  rate. 

The  method  of  solution  is  an  iterative  one,  as  opposed  to  direct 
solution  of  the  linear  equations  for  the  steady  state  probabilities.  The 
reason  for  this  is  that  the  direct  solution  would  require  use  of  a  very 
large  matrix  in  any  of  the  standard  available  computer  software  packages 
for  solving  linear  equations.  This  matrix  would  have  a  vast  majority  of 
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FIGURE  111-23  STEADY-STATE  PROBABILITY  DENSITIES  FOR  VARIOUS  TRUNCATION  LEVELS  OF 
STIMULUS  QUEUE 
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NUMBER  OF  CONTACTS  IN  SYSTEM 


FIGURE  HI-24  STEADY-STATE  PROBABILITY  DENSITIES 
USING  VARIOUS  VALUES  OF  INPUT  RATE 


zeroes  in  it,  thus  rendering  the  solution  extremely  inefficient.  There¬ 
fore,  a  special  algorithm  was  written  for  this  problem,  making  use  of  the 
fact  that  each  row  of  the  matrix  P  has  at  most  five  nonzero  entries,  and 
also  making  use  of  the  special  block  structure  of  the  matrix.  The  method 
of  solution  used  was  the  following  iteration 


t  <n+1) 
A  .P. 

1  1 


E 

■5  =  1 


(n) 

P..P. 

J 


X 

3 


) 


i  /  ^  \  ( n )  I 

where  jp,  , . . . , p_.  is  the  n-th  trial  set  of  probabilities.  After  each 

I  1  n  ) 

iteration,  the  solution  vector  is  normalized  to  ensure  that  numerical  er¬ 
rors  do  not  gradually  accumulate,  which  would  cause  the  sum  of  the  proba¬ 
bilities  to  drift  away  from  a  value  of  unity.  The  initial  trial  solution 
was  taken  to  be  the  vector  (1/N, . . . , 1/N) .  The  above  iteration  did  not 
converge  per  se,  although  it  did  "converge"  to  a  cyclic  set  of  solutions 
having  period  5.  That  is,  after  a  certain  number  of  iterations  (anywhere 
from  60  to  500,  depending  on  >.),  there  began  to  be  a  repetition  of  a  cycle 
of  5  solution  vectors.  In  retrospect,  one  can  easily  see  why  this  system 
should  exhibit  this  behavior.  By  way  of  explanation,  the  matrix  P  is 
periodic  with  period  5,  due  to  the  obviously  periodic  structure  of  the 
flow  graphs  arising  from  the  use  of  Figures  III-4  through  III-8  as  basic 
elements.  The  physical  explanation  is  demonstrated  by  Table  III-2,  con¬ 
taining  an  illustrative  sequence  of  states  that  begin  to  repeat  every  5 
iterations  after  the  9-tli  iteration,  for  up  to  3  contacts  in  the  system. 
For  larger  numbers  in  the  system  the  "transient"  would  be  required  to 
propagate  for  a  larger  number  of  iterations  before  repetition  sets  in. 
Clearly,  these  iterations  repeat  with  a  period  of  5  because  it  takes  5 
steps  to  propagate  a  transfer  around  each  of  the  loops,  and  all  loops 
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Table  II 1-2 


LIST  OF  STATES  OCCUPIED  AS  STEADY  STATE  ITERATIONS 
PROCEED  STARTING  AT  STATE  NUMBER  1  (0  IN  SYSTEM) 


Iteration 

No. 


States  Occupied  J 

(0*) 

(1*) 

(2*) 

(3*) 

1 

1 

2 

2 

3 

3 

6 

4 

4 

7 

16 

5 

5 

8 

10 

17 

6 

1 

9 

11 

18 

20 

7 

2 

12 

13 

19 

21 

26 

8 

3 

6 

14 

22 

23 

27 

9 

4 

7 

15 

16 

24 

28 

29 

10 

5 

8 

10 

17 

25 

30 

31 

11 

1 

9 

11 

18 

20 

32 

33 

12 

2 

12 

13 

19 

21 

26 

34 

13 

3 

6 

14 

22 

23 

27 

14 

4 

7 

15 

16 

24 

28 

29  j 

15 

5 

8 

10 

17 

25 

30 

31 

16 

1 

9 

11 

18 

20 

32 

33 

17 

2 

12 

13 

19 

21 

26 

34  j 

18 

3 

6 

14 

22 

23 

27 

19 

4 

7 

15 

16 

24 

28 

29 

20 

5 

8 

10 

17 

25 

30 

31 

21 

1 

9 

11 

18 

20 

32 

33 

22 

2 

12 

13 

19 

21 

26 

34 

23 

3 

6 

14 

22 

23 

27 

24 

4 

7 

15 

16 

24 

28 

29 

^Number  of  contacts  in  system 


have  period  5  or  multiples  thereof  in  the  steady  state  flow  graph  of  the 
model,  which  is  a  union  of  copies  of  Figures  II 1-4  through  III-8  with 
appropriate  conversion  of  the  transition  rates  X,  etc.,  to  normalized 
p  's,  etc.,  (refer  to  Appendix  A  and  Figure  III-25  for  explanation). 

The  interpretation  of  Table  III-2  is  as  follows.  Initially, 
assume  only  p^  has  a  nonzero  value  (equal  to  1).  After  two  iterations 
this  unit  value  splits  into  two  quantities  summing  to  unity  for  states 
3  and  6;  then  these  split  to  yield  something  for  states  4,  7,  and  16, 
etc.,  (see  Figure  III-25).  Never  do  any  other  states  receive  any  nonzero 
values  for  their  p^'s  except  according  to  the  sequence  in  Table  1 1 1—2 . 

Thus,  no  equilibrium  can  ever  be  reached  because  the  incoming  periodic 
effects  from  other  nodes  always  come  "in  phase"  to  maintain  the  periodic 
behavior  of  this  sequence.  Examples  of  this  cycling  effect  shown  in 
Table  I I 1-2  can  be  traced  on  Figure  I I 1-25. 

In  the  numerical  computations  of  "steady  state"  solutions  the 
values  of  the  last  5  iterations  arc  averaged  because  of  this  periodic 
behavior.  The  oscillations  remaining  after  transients  died  out  were  about 
10r;  of  average  in  their  peak-to-peak  value  in  most  components  of  the  prob¬ 
ability  vector.  Exact  steady  state  solutions  could  be  obtained  by  solving 
the  linear  equations  by  direct  inversion  of  the  P  matrix  (with  one  row- 
removed,  of  course,  as  it  is  singular  and  of  rank  N-l).  This  was  not 
attempted  because  of  the  large  size  of  this  matrix  when  up  to  12  contacts 
in  the  queue  wore  considered.  The  actual  size  of  such  a  matrix  would  be 
NyX,  where 


N  =  1+4+10+19+28+12x28  =  398  , 

and  where  each  term  in  the  sum  corresponds  to  a  particular  number  of  con¬ 
tacts  in  the  system  (see  Table  1 1 1—2 ) . 
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Thus  far,  there  is  not  a  complete  physical  interpretation  of 
this  periodic  behavior  of  the  solution  algorithm,  insofar  as  the  lack  of 
existence  of  a  unique  steady  state  is  concerned.  This  is  a  matter  for 
further  investigation.  In  this  connection,  it  should  be  recalled  that  the 
model  is  linear ,  i.e.,  leads  to  linear  differential  equations  with  periodic 
solutions  of  arbitrary  amplitude  for  the  "steady  state"  probabilities  as 
functions  of  time.  Since  any  practical  system  is  really  nonlinear,  satu¬ 
ration  and  self-sustaining  oscillations  may  occur,  and  there  may  not,  in 
fact,  exist  any  equilibrium  in  the  true  sense,  although  there  may  be  what 
are  known  as  stable  cycles,  i.e.,  continually  repeating  sets  of  states 
(along  some  closed  trajectories  in  the  state  space). 

2 .  Unsaturated,  Saturated,  and  Waiting  Time  Distributions — 

Illustrative  Results 

The  probability  (cumulative)  distribution  for  system  unsaturated 
time  was  calculated  numerically  by  integration  of  the  system  of  differen¬ 
tial  equations  associated  with  the  flow  graph  of  Figure  III-13.  The  method 
of  integration  used  was  basically  centered  around  the  so-called  "successive 
overrelaxation  iterative  method,"  described  in  Reference  10,  for  solution 
of  linear  equations.  This  method  is  not  the  most  efficient  one  available 
but  is  relatively  easy  to  implement  by  suitable  modification  of  the  steady 
state  computer  program.  Furthermore,  this  method  required  no  matrix  in¬ 
versions,  and  the  entire  computer  procedure  is  efficiently  handled  in 
terms  of  node-arc  incidence  of  the  flow  graphs,  rather  than  by  storing 
huge  matrices  (as  in  the  usual,  general  approach  to  differential  equation 
integration).  Also,  the  overrelaxation  approach  led  to  easy  modification 
of  the  unsaturated  time  program  to  obtain  programs  for  calculations  of 
saturated  time  and  waiting  time  distributions.  (Due  to  lack  of  time,  the 
time-in-the-system  calculations  were  not  completed  so  as  to  be  included 
in  this  report.)  The  mathematical  technique  is  developed  in  Appendix  B, 
Some  illustrative  results  are  presented  below. 
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The  values  of  to  used  for  the  unsaturated  system  time 
distribution  calcualtion  are  given  in  Figure  III-24.  The  value  of  X  was 
taken  to  be  3.5.  The  calculated  (cumulative)  probability  curve  for  un¬ 
saturated  time  is  given  in  Figure  I I 1-26. 


9  1 08 


TIME  (t> —  hr 


FIGURE  111-26  PROBABILITY  DISTRIBUTIONS  FOR  UNIT  MODEL 

Basically,  the  same  approach  was  used  for  saturated  and  waiting 
time  as  for  unsaturated  time,  except  that  much  larger  flow  graphs  had  to 
be  dealt  with  for  the  first  two,  forcing  consideration  of  a  maximum  of 
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5  stimuli  in  the  first  queue,  QD,  whereas  up  to  11  stimuli  were  considered 
in  Qd  for  the  unsaturated  time  case.  The  reason  for  this  was  a  desire  to 
adhere  to  a  reasonable  total  CPU*  time  constraint  per  run,  and  run  time 
is  more  or  less  proportional  to  total  number  of  states  of  the  model.  As 
stated  earlier,  the  method  of  integration  to  date  is  net  yet  refined  for 
efficiency;  rather,  the  main  concern  was  relative  ease  of  programming  for 
the  purposes  of  experimentation  with  the  prototype  model.  Better  integra¬ 
tion  methods  are  discussed  in  the  next  section.  The  results  of  computa¬ 
tions  for  saturated  time  and  waiting  time  are  included  in  figure  III-26. 
Note  that,  if  these  distributions  were  actually  exponential  as  assumed 
in  Section  IV,  their  curves  would  be  straight  lines.  Thus,  one  can  see 
from  Figure  I I 1-26  that  the  simplifying  assumptions  of  Section  IV  are  not 
too  unrealistic,  especially  for  waiting  time. 

In  ASW  terms,  then,  Figure  III-26  shows  the  probability  of: 

1.  A  stimulus  having  to  "wait"  a  time  up  to  "t"  hours  (t 
hours  or  less)  before  detection  capability  is  applied 
to  that  stimulus 

2.  The  system's  being  saturated  (no  detection  availability) 
for  up  to  t  hours 

3.  The  system's  having  continuous  detection  availability 
for  up  to  t  hours . 

E.  Areas  for  Further  Research 
1 .  Numerical  Calculations 

There  are  several  alternative  approaches  to  numerical  calcula¬ 
tion  of  both  the  steady  state  and  transient  queuing  models  employed  thus 
far.  Some  alternatives  have  already  been  mentioned,  such  as  folding  the 


Central  processor  unit  in  a  computer. 
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flow  graph  for  steady  state  and  using  a  direct  instead  of  an  iterative 
linear  equation  subroutine  in  numerical  integration. 

Some  additional  alternatives  to  be  investigated  are  flow  graph 
reduction  through  algebraic  manipulation  by  computer  and/or  direct  calcu¬ 
lation  of  flow  graph  transmission  through  use  of  "gain  formulas,"  such  as 

those  of  Mason,  Coates,  and  the  more  recently  introduced  Chan-Mai  flow 

,  11 

graph. 

2 .  Extension  of  Model  to  Include  Nonexponential  Statistics 

The  model  has  so  far  been  restricted  to  having  exponential  dis¬ 
tribution  for  all  transition  probabilities  between  states  of  the  system. 

As  pointed  out  in  Appendix  A,  this  amounts  to  creating  a  Markov  process. 

The  general  theory  of  flow  graphs  extends  easily  to  semi-Markov  processes, 
which  would  result  from  allowing  more  general  interstate  transition  dis¬ 
tributions.  Numerical  calculation  techniques  for  semi-Markov  flow  graphs 
have  yet  to  be  investigated.  In  the  case  of  rational  Laplace  transforms 
in  a  semi-Markov  flow  graph,  it  is  possible  to  represent  each  arc  in  it 
by  a  subnetwork  of  arcs  having  a  transmission  of  the  type  a/(s+b),  thereby 
creating  a  higher  dimensional  Markov  process.  For  more  general  semi-Markov 
flow  graphs  rational  approximations  can  be  used.  Alternative  approaches 
to  be  examined  may  include  available  techniques  for  direct  integration  of 
the  mtegro-dif /erential  equations  that  arise  for  a  semi-Markov  process. 

The  Laplace  transformed  version  of  these  is  given  in  Equation  (A-17)  of 
Appendix  A. 

The  flow  graph  methodology  fortunately  lends  itself  as  a  con¬ 
venient  general  noproach  to  formulation  of  integro-differential  equations. 
The  literature  on  the  subject  of  integral  equations  pertaining  to  queuing 
theory  consists  of  a  great  "bag  of  tricks,"  each  individually  derived  for 
a  very  specific  problem.  Thus  far,  it  has  not  been  found  possible  to  find 


a  direct  application  of  papers  on  integral  equations  in  queuing  theory 
as  stated  in  Section  III-A,  but  it  appears  likely  that  the  unifying  flow 
graph  technique  will  lead  to  satisfactory  solution  of  the  integral  equa¬ 
tions  arising  for  more  general  models  than  so  far  considered. 

3 .  Addition  of  Classification  and  Hand-off  Functions 

The  above  remarks  on  integro-dif ferential  equations  and  flow 
graphs  are  pertinent  to  extension  of  the  unit  model  to  include  various 
other  ASW  functions  omitted  so  far.  These  functions  can  be  introduced 
by  compounding  the  dimensionality  of  the  type  of  Marker  or  semi-Markov 
model  employed  to  date.  This  approach  will  probably  involve  consolidating 
states  of  the  resultant  highly  dimensional  semi-Markov  process  and  approx¬ 
imating  it  by  a  simpler,  lower  dimensional  process.  There  has  been  a 
great  deal  of  work  done  in  systems  analysis  on  approximation  of  functions 
by  simpler  rational  functions,  and  this  area  of  techniques  should  be  in¬ 
vestigated. 
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IV  ASW  FORCE  EFFECTIVENESS  MODEL 


The  purpose  of  this  section  is  to  describe  the  development  of  the 
ASV.'  force  effectiveness  model.  In  this  case  effectiveness  is  defined  as 
the  probability  that  an  ASW  stimulus  will  be  defected  by  at  least  one  of 
the  force  sensors  in  sufficient  time  for  effective  counteraction  by  units 
and/or  operating  units  of  the  force.  In  this  model  the  effective  counter¬ 
action  of  the  operating  units  is  not  explicitly  represented,  but  is  implied 
through  the  incorporation  of  certain  statistical  results  from  the  unit 
model . 

In  addition  to  a  description  of  the  model  formulation,  illustrative 
computer  results  are  presented  and  the  areas  and  direction  for  future  model 
expansion  are  indicated. 

A .  Model  Development 

Consider  a  naval  force  which  includes  a  certain  number  of  ASW  and/or 
operating  units.  For  the  sake  of  simplicity,  operating  units  will  be 
referred  to  hereinafter  as  units  except  when  ambiguity  might  result. 

For  the  purposes  of  this  model,  consider  that  the  ASW  elements  are 
described  as  a  collection  of  i  (i=l  ,2,3, . .  .  ,in)  ASW  sensors,  some  of  which 
may  be  collocated  on  the  same  platform.  In  addition,  there  may  be  dupli¬ 
cations  of  the  various  sensor  types  within  the  force  since  the  i  indexing 
serves  only  to  enumerate  the  sensors  and  not  to  categorize  them.  Let 

(x  ,v  )  be  the  position  of  the  force  reference  point,  either  force  center 
o  '  o 

or  position  and  intended  movement  (PIM).  Since  all  velocity  vectors  in 
the  development  that  follows  are  considered  to  represent  motion  relative 
to  tins  reference  point,  there  is  no  loss  of  generality  if  (xQ,y^)  is 
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assumed  to  be  nositioned  at  the  origin  of  a  rectangular  coordinate  system 

til 

(see  Figure  IV-1).  Let  the  position  of  the  i  sensor  relative  to  the 
force  reference  position  within  this  coordinate  system  be 

th 

In  a  similar  manner,  let  the  position  of  the  r  stimulus 

(r=l , 2 , 3 , . . . )  relative  to  the  force  reference  position  be  (xs>ys)r* 

In  most  of  the  discussion  that  follows,  the  r-index  will  be  suppressed 

for  the  sake  of  notational  simplicity,  so  that  stimuli  positions  will 

be  referred  to  merely  as  (x  ,y  ).  The  identity  of  the  specific  stimulus 

s  s 

under  discussion  should  be  clear  from  the  context  of  the  discussion,  but, 
if  this  is  not  the  case,  the  r-index  notation  will  be  employed.  Other 
quantities  are  defined  as  indicated: 


DEFINITION  OF  SYMBOLS 


S  The  set  of  all  ASW-significant  stimuli. 

T  A  subset  of  S  consisting  of  all  submarine 

related  stimuli. 


F  A  subset  of  S  consisting  of  all  non¬ 

submarine  related  stimuli. 

S  (k=l,2, . . . ,n* )  A  sequence  of  subsets  of  S  each  of  which 

K 

consists  of  stimuli  which  exhibit  identical 
ASW  related  characteristics.  By  construction 


S(i) 


S.flS,  =  0  j^k 

3  k 

\JS  =  S  . 

k  k 

A  member  of  a  particular  subset,  S  ,  may 

K 

be  referred  to  as,  "a  k-type  stimulus." 

It  should  also  be  noted  that  for  some  k^, 
k  ,  and  k,  it  may  be  that: 


k  eS 
1  k 


k  eS 
2 


k 


k  eT  k  eF 
1  2 


A  subset  of  S  consisting  of  all  stimuli 

th 

for  which  detection  by  the  i  sensor  is 
possible . 

th 

Maximum  detection  range  of  the  i  sensor 


for  a  k-type  stimulus  (see  Figure  IV-1). 


R 


The  radius  of  the  force  area  of  interest 


(see  Figure  IV-1). 

g  (R)  The  single  look  probability  that  the  i 

IK 

sensor  will  detect  a  k-type  stimulus  given 

that  the  stimulus  is  at  range  R  and  the 

th 

detection  capability  of  the  1  sensor 
is  not  saturated.  Applies  to  sensors 
which  employ  a  "glimpsing"  type  of 
operation. 


(R) 


WR 

V.  =  (9.,  v.) 
1  11 


V  =  (cj>  ,  v  )  . 

S  S  S  J 


The  instantaneous  probability  density  of 
th 

detection  of  the  i  sensor  for  a  k-type 

stimulus  given  that  the  stimulus  as  at 

range  R  and  the  detection  capability  of 
th 

the  l  sensor  is  not  saturated.  Applies 
to  sensors  which  employ  a  "continuous 
looking"  type  of  operation. 


Submarine  weapon  range  (see  Figure  IV-1). 

,  ,  th 

The  velocity  vector  of  the  l  sensor 

(operating  element)  relative  to  the  force 

reference  point,  V.  is  described  by  a 

heading  (direction  of  relative  movement), 

9.,  measured  counterclockwise  from  the 

l 

positive  x-axis,  and  a  velocity,  v. . 

th 

The  velocity  vector  of  the  r  stimulus 

relative  to  the  force  reference  point, 
r 

V  is  described  by  a  heading,  cp  ,  measured 
s  s 

counterclockwise  from  the  positive  x-axis, 

and  a  velocity,  v  .  As  previously  stated, 
s 

the  r-index  will  normally  be  suppressed . 


Now  consider  the  force  at  time  t*  (see  Figure  IV-1).  M  stimuli 
have  been  presented  to  the  units  of  the  force  up  to  time  t*  of  which 
L  stimuli  have  become  contacts  (L  £  M) .  Of  these  L  contacts,  i  are  cur¬ 
rently  being  prosecuted  by  the  units  of  the  force  and  £(i)  are  being 
prosecuted  by  the  unit  of  which  the  ith  sensor  is  a  part.  Obviously, 

i  = 

i 

and 

0  £  £(i)  £  &  for  all  i 

which  constitutes  the  load  on  the  force  and  individual  systems  respec¬ 
tively  at  time  t*. 

At  time  t*  the  (M+l)st  stimulus  is  presented  to  the  force,  that  is, 
the  (M+l)st  stimulus  appears  within  range  R  of  the  force  center.  The 
questions  to  be  addressed  are:  (1)  will  the  (M+l)st  stimulus  become  a 
contact  within  the  ASW  system?  and  (2)  if  so,  will  there  be  sufficient 
time  for  effective  counteraction  by  the  elements  of  the  force?  The  degree 
to  which  these  two  questions  collectively  are  answered  in  the  affirmative 
constitutes  the  force  level  measure  of  effectiveness.  Clearly,  the  first 
question  may  be  interpreted  in  terms  of  the  probability  that  at  least  one 
of  the  lorce  sensors  will  detect  the  (M+l)st  stimulus;  the  second  question 
concerns  the  time  required  for  detection. 

With  regard  to  this  latter  point,  for  a  given  stimulus  initial 

position,  velocity  vector,  and  weapon  range,  there  is  a  maximum  time,  Tq,, 

within  which  a  "true"  stimulus  must  be  countered.  In  Figure  IV-1,  the 

time  TT  would  correspond  to  the  time  required  for  the  stimulus  to  transmit 

from  (x  ,y  )  to  the  point  B  on  the  weapon  range  boundary.  In  this  and 
s  s 

the  subsequent  model  development,  it  is  assumed  that  the  defended  portion 
of  the  force  does  not  take  evasive  action  to  avoid  a  contact.  Such 


..4  '  <*.  .  "  S 


action  introduces  the  concepts  of  action  and  counteraction  between  the 
defended  force  and  the  contact ,  which  are  beyond  the  scope  of  the  model 
at  this  time. 

The  model  does,  however,  incorporate  provisions  for  specifying  the 
movement  of  the  ASW  units.  Such  movement  is  dictated  by  the  i  contacts 
presently  in  the  system  and  is  not  due  to  the  presence  of  the  (M+l)st 
stimulus.  This  consequence  is  obvious  and  stems  directly  from  the  fact 
that  only  initial  detection  of  the  (M+l)st  stimulus  is  being  considered. 

As  a  result,  the  force  is  unaware  of  the  presence  of  this  stimulus.  It 
is  also  possible,  under  actual  operational  conditions,  that  the  motion 
of  the  ASW  units  will  be  in  response  to  the  occurrence  of  contacts  sub¬ 
sequent  to  the  appearance  of  the  (M+l)st  stimulus.  This  leads  to  more 
complicated  provisions  for  describing  the  relative  st imulus-unit  movement, 
which  are  not  yet  incorporated  within  the  present  model  structure. 

At  time  t*  assume  that  the  (M+l)st  stimulus  is  located  at  (x  ,y  ) 

s  s 

and  is  proceeding  in  accordance  with  a  velocity  vector,  V  ,  relative  to 

the  force  reference  point.  Assume,  too,  that  the  position  and  velocity 

vector,  (x  , y  )  and  V  ,  are  known  for  each  of  the  i  sensors.  Recall  that 
i  i  i 

it  is  possible  that 


(x.,y.)  =  (x  ,y.) 

11  j  J 


V.  =  V . 
i  J 


for  some  i  and  j  due  to  the  enumeration  feature  of  the  i- index  and  the 
possibility  of  sensor  collocation.  In  addition,  let  a  submarine  weapon 
range,  WR,  be  established  about  the  units  of  the  defended  force  to 
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delineate  the  limit  for  possible  ASW  counteraction.  This  is  the  situation 
depicted  in  simplified  form  in  Figure  IV-1. 

th 

Consider  the  i  sensor  and  assume  that  the  (M+l)st  stimulus  is  a 
k'-type  stimulus  such  that 


(M+l)e  S,  ,  c  s(i) 

k' 


(IV-A-1) 


R.. ,  <  RT. 

ik'  lk 


(IV-A-2) 


for  at  least  some  portion  of  the  relative  stimulus  track  within  R.  These 

th 

two  conditions  are  assumed  in  order  to  insure  that  the  i  sensor  is  po¬ 
tentially  capable  of  contributing  positively  to  the  effectiveness  of  the 

th 

force.  If  either  condition  is  violated,  the  contribution  of  the  i  sensor 
is  obviously  nil. 

It  is  quite  possible  that  the  (M+l)st  stimulus  will  not  be  within 

th  * 

detection  range  of  the  i  sensor  at  t  .  However,  under  the  assumption 

contained  in  (IV-A-2),  there  exists  an  initial  time  t  (see  Figure  IV-1) 

o 

and  a  subsequent  period  when  the  stimulus  will  be  within  detection  range 
of  the  i*’*'  sensor.  This  period,  designated  T.  (i=l,2,3, . .  .  ,m)  ,  is  the 


maximum 


detection  interval  available  to  the  i ^  sensor.  The  actual  de¬ 


tection  interval  available  to  the  i  sensor  will  now  be  determined. 

Assuming  that  the  (M+l)st  stimulus  originates  from  an  attacking 
submarine,  the  time  at  which  the  stimulus  reaches  the  weapon  range  bound¬ 
ary  is 


t*  +  T 
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and  the  amount  of  time  available  to  the  i  ser.sor  in  which  to  accomplish 
detection  and  effective  counteraction  is 

T  (i)  =  T  +  t*  -  t  (i=l,2,3,  . . .  ,m)  (IV-A-3) 

T  T  o 

where,  bv  definition  t  s  t*. 

J  o 

Let  t. (i+1,2,3, . . . ,m)  be  the  time  required  by  the  ASW  unit  of  which 

the  i*"*1  sensor  is  a  part  to  prosecute  a  contact,  7  is  a  random  variable 

i 

which  may  be  contact  dependent  and  most  certainly  is  dependent  on  relative 
contact-unit  geometry.  Assume  that  the  distribution  function,  FT(z) ,  su..^ 
that 

Vz)  -  p[t.  s  *] 

for  the  system  load  £(i)  is  known,  and  that  the  statistical  properties 
of  this  distribution  are  not  significantly  altered  by  the  detection  of 
the  (M+l)st  stimulus  and  its  subsequent  introduction  into  the  system. 

From  a  practical  viewpoint  it  is  expected  that  Ft^(z)  will  be  determined 
from  the  unit  model  and  input  to  the  force  effectiveness  model. 

Two  situations  relating  the  i  sensor  and  the  (M+l)st  stimulus  are 

possible,  depending  upon  the  relationship  that  exists  between  the  weapon 

.  th 

range  circle  about  the  defended  force  and  the  detection  field  of  the  i 

sensor.  These  two  conditions  are  illustrated  in  Figure  IV-1.  Referring 

to  Figure  IV-1,  the  first  sensor,  located  at  (x^y^),  must  detect  and 

counter  the  stimulus  during  its  transit  from  (x  ,y  )  to  point  B.  On  the 

s  s 

other  hand,  the  second  sensor,  located  at  (x9,y2>,  need  only  detect  the 

stimulus  during  its  transit  from  (x  ,y  )  to  point  A,  assuming,  of  course, 

s  s 

that  there  is  sufficient  time  for  effective  counteraction  before  the 
stimulus  reaches  point  B. 


Now  the  time  for  the  stimulus  to  reach  point  A  is  t*  -  t  +  T  and 

o  2 

the  time  to  reach  point  B  is  t*  -  t  +  T  .  For  the  first  sensor  the 

O  I 

actual  detection  interval  available  (DI)^  is  given  by 


(DI)  =  t*-t  +  T  -T  =  T  (1)  -  t 
1  oil  T  1 

through  the  use  of  (IV-A-3).  The  corresponding  detection  interval  for 
the  second  sensor,  (DI)^  is 


(DI)  =  t*  -  t  +  T 
2  o  2 


assuming  that  t  £  (t  -  t  +  T  )  -  (t*  -  t  +  T  )  =  T  -  T 
2  o  2  0  12  1’ 

Geneializing  these  two  conditions,  the  actual  detection  interval 

available  for  the  i*"*1  sensor  is 


t  +  TT  ~  Ti  2  to  +  Ti 


t  -  to  ♦  Tr  -  T.  t*  ♦  Tt  -  Tt  <  to  +  Tt 


or,  more  concisely, 


't  ■  ”1»[T1  -  y»  -  t.]  (1=1,2, a . . 


(IV-A-4) 


where  T,,(i)  is  defined  by  (IV-A-3),  T.  is  the  total  time  the  stimulus  re¬ 
mains  within  detection  range  of  the  ifch  sensor,  and  it  is  assumed  that 

TT(i)  ~  ta  >  0. 

Before  proceeding,  a  discussion  of  some  of  the  relevant  features  of 
the  unit  model  is  necessary.  In  its  present  form,  the  unit  model  is  a 
queuing  model  of  the  ASW  functions  of  a  unit  consisting  of  multiple 
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service  stages  in  series  with  multiple  service  facilities  in  most  of  the 
stages,  such  as,  the  detection  stage.  However,  the  unit  model  considers 
only  the  time  necessary  to  accomplish  detection,  not  the  probability  that 
detection  will  occur.  In  order  to  develop  some  of  the  statistical  quan¬ 
tities  which  describe  the  functioning  of  a  unit,  a  hypothetical  queue  is 
assumed  to  exist  ahead  of  the  detection  function.  Clearly,  this  does  not 
represent  actual  conditions  since  stimuli,  particularly  submarine  stimuli, 
do  not  "wait"  on  the  ASW  system.  The  use  of  this  artifice  does  permit, 
however,  the  determination  of  such  quantities  as:  (1)  the  probability 
that  a  stimulus  that  encounters  the  ith  sensor  at  time  t  will  not  have  to 
wait,  which  is  equivalent  to  the  probability  that  the  detection  server  is 
available;  and  (2)  The  probability  that  the  stimulus  will  wait  for  a  time 
less  than  some  time,  say  t ' ,  given  that  it  waits  at  all.  This  latter 
probability  is  equivalent  to  the  probability  that  the  remaining  portion 
of  the  detection  server  saturated  period  is  les-  than  t\  given  that  the 
server  is  saturated.  In  this  context,  a  saturated  period  is  defined  to 
be  the  period  throughout  which  the  detector  server  is  fully  occupied.  By 
contrast,  an  unsaturated  period  is  defined  to  be  the  period  when  some 
portion  of  the  system  detection  capability  is  available  to  acquire  new 
targets.  Because  of  the  probabilistic  nature  of  detection,  it  is  quite 
possible  that  a  detector  server  may  be  unsaturated  even  though  appropriate 
stimuli  are  present  and  within  range. 


Let  Xw,  Xg,  and  X(  be  random  variables  representing,  respectively, 
the  length  of  a  stimulus-customer’s  wait  in  the  detection  queue,  the  length 
of  a  detection  server  saturated  period,  and  the  length  of  a  detection 
server  unsaturated  period.  Assume  that  the  distribution  functions  Fx  (t), 
V”,  and  Fxu(t)  are  known  as  a  result  of  exercising  the  unit  model! 

Then,  by  definition  of  a  distribution  function: 
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'sWI15,  '  - 


pfx  £ 

L  w 


P  X  £ 
_  s 


p[x  £ 

L  « 


*] 

*] 

*] 


Fx  <*> 

Aw 


FXs(t) 


Fv  (t) 


t 

fv  (x)dx 
Aw 


t 

fv  (x)dx 

AS 


t 

fv  (x)dx 
Au 


As  previously  stated,  Fy  (t)  for  t  >  0,  represents  the  probability  that 

A\v 

the  remaining  portion  of  the  current  detector  server  saturated  period  will 
last  at  most  t  time  units  after  the  arrival  of  a  stimulus-customer.  Ob¬ 
viously,  a  stimulus  may  arrive  during  a  detector  unsaturated  period  and 
so  there  is  a  positive  probability  that  the  initial  waiting  period  will 
be  of  length  zero.  This  fact  is  utilized  in  the  force  model  by  consider¬ 
ing  that  the  sequence  of  saturated  and  unsaturated  periods  of  detector 
server  activity  faced  by  a  stimulus  always  starts  with  a  saturated  period, 
albeit  a  period  possibly  of  length  zero.  Subsequent  saturated  periods, 
so  far  as  a  particular  stimulus  is  concerned,  do  not  exhibit  this  charac¬ 
teristic  . 


Implicit  in  this  last  discussion  is  the  assumption  that  the  detector 
server  is  of  finite  capacity.  It  is  apparent  that  a  server  with  an  ex¬ 
ceedingly  large  or  infinite  capacity  might  never  experience  a  saturated 
period,  but,  under  present  practical  operating  restraints,  such  servers 
are  not  likely  to  be  encountered. 

th 

The  procedure  for  determining  the  probability  that  the  x  sensor 
will  detect  the  (M+l)st  stimulus  during  the  detection  interval  (DI).  is 


as  follows. 


Define  a  sequence  of  time  points,  [t  }  (k=l,2,3, . . . ,n) ,  such  that 


t  <  t  <  t 
o  1  2 


<  t  .  From  this  sequence  of  time  points,  construct  a 
n 


sequence  of  intervals,  (I  }  (k=l ,2 ,3 , . . . ,n) ,  with  length,  L(I  ),  equal  to 

k  k 

t  -t  .  It  is  assumed  that  the  L(I  )  are  independent  random  variables 
k  k-1  k 

with  the  distribution  function: 


pjuo  £  t 


f 

i 


w 


<t) 

(t) 

j=2k-l,  k=2 , 3 , , 

.  .  . ,  n/2 

(t) 

j=2k,  k=l, 2, . . 

. ,  n/2 

Since  only  sequences,  { I ^  } ,  which  terminate  with  an  unsaturated  period 
are  of  practical  importance,  the  number,  n,  of  intervals  in  the  sequence 
will  a] ways  be  even. 

Now,  during  the  (DI)_  the  (M+l)st  stimulus  will  be  exposed  to  the 
1th  sensor  during  periods  when  the  i*"11  sensor  is  unsaturated  and  when  it 
is  saturated.  Of  course,  detection  of  the  (M+l)st  stimulus  can  take  place 
only  during  one  of  the  unsaturated  periods.  This  condition  raises  ques- 

i.U 

tions  regarding  the  number,  spacing,  and  length  of  the  iu  sensor  unsat¬ 
urated  periods. 

s  u 

Define  the  two  sums,  S  and  S  as  follows 

j  j 


2j-l 

*  E  «y 


j  =  1,2,3, .. , , n/2 


(IV-A-5) 


su  -  Ss  +  X 
j  3  u 


j  =  1,2,3,..., n/2 


(IV-A-6) 


where  Xu  =  L. (I  ).  The  quantity,  S  ,  represents  the  sum  of  the  lengths 
j  2j  j 

of  the  first  j  saturated  periods  and  the  first  j-1  unsaturated  periods. 
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Whereas,  s"  represents  the  sum  of  the  first  1 


periods  alike. 


j  saturated  and  unsaturated 


The  density  functions  of  the  two  sums  in  (IV-A-5)  and  (IV-A-6)  may 
be  derived  by  applying  a  well-known  rule  of  probability  theory  regarding 
ranaom  sums.  This  rule  states  that  the  density  function  of  a  random  sum 
of  independent  random  variables  is  the  convolution  of 


tions  of  all  of  the  random  variables 


ie  convolution  of  the  density  func- 
comprising  the  sum.  Thus, 


f  00  =  £  00  =  fx  00 

_  •*»  tlf 


f  u(x)  =  f  S(x)  *  fv  (x) 
S  S  u 

11 


fcs(x)  =  f  u(x)  *  fX _(*) 
S2  S1 


f  (x) 
^2U 


=  f  (x)  *  f  (X) 
s  Alt 


or,  in  general 


f  (x) 

ss 

1 


(IV-A-7) 


fqs(X>  =  fu  (x)  *  fXs<x>  0=2,3, ...,n/2 


(IV-A-8) 


fsu(x)  =  fgS<x>  *  fXu(x)  j=l,2,3, ...,n/2 

J  Sj 


(IV-A-9) 


where  (*)  denotes  convolution. 
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th 

Let  d.  .  be  the  probability  that  the  i  sensor  detects  the  (M+l)st 
1-  J 

stimulus  in  the  ,  unsaturated  period  and  not  before.  This  probability 
is  determined  as  follows. 


The  j^*1  unsaturated  period  commences  at  some  time,  t’,  where  for 
d  .  >  0,  t ’ ,  in  absolute  time,  must  be  in  the  interval  t  <  t'  £  t  +  (DI).. 
Since  only  the  i^'1  sensor  is  of  concern  in  this  discussion,  there  is  no 
loss  of  generality  if  t*  is  considered  relative  to  the  ith  sensor  detec¬ 
tion  period  so  that  the  range  of  values  for  f  is  0  £  t1  £  (DI)^.  The 
length  of  the  j1"'1  unsaturated  period  is  equivalent  to  L(I  )  and  0  <. 

L(I  )  £  (DI)  -  t'.  In  the  interest  of  future  notational  simplicity, 

-J  i 

let: 


L<V  5  y 


(I V-A-10) 


Let  p D ( y 1 1 ' >  be  the  probability  that  the  ith  sensor  will  detect  the 
(M+1 )st  stimulus  ’n  an  interval  >>f  length  y  given  that  the  interval  starts 
at  t'.  Assume  for  the  present  that  PD(y|0)  is  given  by 


so  that 


pD(ylo) 


f^(x)dx 


?D ( y 1 1 1 ) 


f  (x)dx 


(IV-A-11) 


Then,  d  (y , t ’ ) ,  the  probability  that  the  (M+l)st  stimulus  is  detected  by 
ij 

the  i1*1  sensor  in  the  j1"11  unsaturated  period  commencing  at  t’  and  of 
length  y  and  not  before,  is 
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dij(y,t,)  = 

.  P[jth  unsaturated  period  is  of  length  y 1 1 * ] 

r  th  , 

.  P|_j  unsaturated  period  starts  at  t  J 

.  P[no  detection  in  first  j-1  unsaturated  periods] 


and 


(DI)  .  (DI)  .  -f 

/  ‘"7  ‘ 

o  o 


d.  . (y, t ' )dy 


(DI) .  (DI) . -t ' 

/  ‘*7  ' 

o  o 


pD<ylt ’ )  *  fXu(y)  *  f  s(t'}  *  PD(d_1)dy 

Sj 


(DI). 

r  t 


(Dl).-t’ 


dt'  f 


p„(y|t’)  •  fx „<y>dy 


pd(.i-u 


(IV-A 


where  P^j-l)  is  the  probability  of  no  detections  in  the  first  j-1  un¬ 
saturated  periods. 


th 


The  probability.  D  ,  that  the  (M+l)st  stimulus  is  detected  by  the 
ij 


i  sensor  at  some  time  during  the  first  j  unsaturated  periods  is 


D 

ij 


•12) 


j=l,2,3t  . . . ,n/2 


(IV-A- 13) 


with 


V0) 


1 


j~l 

P  (j-1)  =  1  -  D.  =  1  -  ^  d.  j=2,3, . .  . ,n/2  .  (IV-A-14) 

D  J  i> j-i  iri 


In  particular,  the  probability  that  the  ith  sensor  detects  the  (M+l)st 
stimulus  is: 


D 

l 


n/2 

y*  d. . 

ij 


j=i 


It  should  be  noted  that,  due  to  the  inherent  physical  restraints  of  the 

engagement  situation,  D,  is  likely  to  be  less  than  unity  with  the  prob- 

til  _ 

ability  of  the  l  sensor  failing  to  detect  being  equal  to  1  -  D.  =  P^Cn/2). 

Recall  from  (IV-A-4)  that  (DI)  is  the  minimum  of  either  T  or 

i  i 

T  (i)  -  t  .  If  T  <  T  (i)  -  t  then  the  expression  in  (IV-A-12)  gives 
T  i  i  T  i 

the  desired  probability  since  T  ,  and  so  (DI).,  for  the  stated  conditions 

i  i 

is  a  known  or  determinable  value.  If,  however,  0  <  T^d)  -  t\  <  T\  ,  the 

length  of  the  detection  interval,  (DIK,  becomes  a  random  variable  and 

the  d  of  (IV-A-12)  should  be  written  as  d  (DI),  i.e.,  as  a  function 
ij  iJ 

of  the  length  of  the  detection  interval.  In  this  case,  d  would  be 

ij 

determined  by: 


P  (j-1)  .  (IV-A-15) 


ij 


y» 


£di(z) 


d  (z)dz 
ij 
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It  is  necessary,  in  this  case,  to  derive  the  probability  density  function, 
f^(z),  for  the  length  of  the  detection  interval.  Therefore,  Tor: 


(DI) .  -  T  (i)  -  T  (T.  a  random  variable) 

i  T  1  3. 


?(DI).(Z)  =  P[(D1)i  5  Z]  =  P[TT(i>  -  T.  *  z]  =p[t.  ^  TT(i)  -  z] 


T  (i)-z 

r  T 


=  1  -  Ft.(T  (i)  -  z)  =  1 

'l  T 


fT. (x)dx 


Differentiating, 


f 


(DI). 

l 


(z) 


fT.(TT(i) -  z) 


so  that  (IV-A-15)  becomes 


d. 

ij 


T  (i) 
-  T 


f^C^Ci) 


z)d  (z)dz 
13 


PD(d-W 


(IV-A-16) 


since  i'_  (z)  is  assumed  known  from  the  unit  model,  and  d  (z)  represents 
i  i  j 

the  value  of  the  expression  in  the  brackets  on  the  right-hand  side  of 
(IV-A-12) . 

In  the  present  development,  no  consideration  is  given  to  either 
maneuvering  to  increase  fand  thus  T^(i)]  or  to  hand-off's  between 
operating  units.  Obviously,  in  real  situations  it  is  possible  for 
T^(i)  -  t.  <  0  <  T. .  This,  quite  naturally,  gives  rise  to  questions  re¬ 
garding  the  existence  of  another  unit  with  prosecution  time  of,  say, 
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t.,  where  (x  ,y  )  r  (x  ,y  ),  i.e.,  the  sensor  is  not  a  part  of  the 
0  i  i  j  j 

4>U 

same  unit  as  the  1  sensor  and  such  that: 


T  (i)  -  T.  <  0  <  T  (i)  -  T. 
T  i  T  j 


This  also  suggests  that,  from  the  force  point  of  view,  it  might  be  possible 
to  find  a  unit  containing  the  j*"*1  sensor  such  that,  for  the  (M+l)st  stim¬ 
ulus: 


T  =  min  (T.) 
j  i  X 


As  stated,  these  and  other  associated  questions  have  not  yet  been  addressed. 

Continuing  with  the  model  development,  the  probability  that  at  least 
one  of  the  i  sensors  comprising  the  ASW  force  will  detect  the  (M+l)st  stim¬ 
ulus  in  time  for  effective  counteraction  is 


D  =  1 


m  m  /  n/2 

-  f[  (1  -  D.)  =  1  -  f[  (l  -  £ 


(IV-A-17) 


where,  of  course,  many  of  the  D.  may  be  identically  zero  since  either  the 
(M+l)st  stimulus  is  not  of  the  proper  type:  (M+l)  e  S  S(i)  or 

K 

R  >  R*  for  all  of  the  relative  stimulus  track  within  R,  The  quantity 
ik  ik 

D  constitutes  the  ASW  force  measure  of  effectiveness. 


The  probability  D  in  (IV-A-17)  should  be  written  as  D(X  ,Y  ,V  )  since 

s  s  s 

the  quantity  D  is  actually  a  function  of  the  initial  position  of  the 

(M+l ) st  stimulus  and  ' ts  assumed  velocity  vector.  If  the  position  (x  ,y  ) 

s  s 

were  allowed  to  vary  over  all  possible  feasible  positions  wiMiin  R  (with 

V  assumed  constant  for  all  stimuli),  the  value  D  would  trace  out  a  sur- 
s 

face  which  would  characterize  tne  detection  capability  of  the  force.  A 


series  of  these  surfaces  for  various  stimulus  velocity  vectors,  V  , 
could  serve  to  diagnose  the  ASW  detection  weaknesses  of  the  selected 
force. 

It  remains  to  develop  the  functional  form  of  the  probability  that 
the  i*"*1  sensor  will  detect  the  (M+l)st  stimulus  in  an  interval  of  length  y, 
i.e.,  the  P^Cyjt')  in  (IV-A-11).  Two  cases  must  be  considered:  the  con¬ 
tinuous  looking  type  of  sensor  and  the  intermittent  or  "glimpsing"  type 
of  sensor.  In  both  cases  it  is  assumed  that  a  probability  of  detection 
versus  range  curve  appropriate  to  the  sensor  type,  its  operational  style 
and  the  pertinent  environmental  conditions  exists  and  is  known.  This 

curve,  functionally,  is  either  g  ,  (R)  or  v..  (R)  depending  upon  the  sensor 

j.k  ik 

style  of  operation.  It  should  be  noted  that,  since  sensor  and  stimulus 
initial  positions  and  velocity  vectors  are  assumed  known,  both  g.^(R)  and 
Yik (R)  are,  in  fact,  continuous  functions  of  time  since  the  range  between 
the  sensors  and  the  stimulus  may  be  expressed  as  a  continuous  function 
of  time. 

Consider  the  continuous  looking  case.  Koopman12  has  shown  that  the 
probability  of  detection  in  this  case  is  given  by 


PD ( y ! t '  > 


(IV-A-18) 


where 


t  '+y 

F[c]  =  f  Y .  [R(t)]dt  ( IV-A- 

•V 

and  the  integral  in  (IV-A-19)  is  a  lino  integral  along  the  path  traced  by 

the  (M+l)st  stimulus  relative  to  the  it!l  sensor.  The  expression, 

y,  [R(t)],  is  employed  in  (IV-A-19)  to  show  explicitly  the  functional 
ik 

dependence  of  y  upon  time. 
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Obviously,  (IV-A-18)  and  (IV-A-19)  result  in  a  continuous  function 

in  the  two  variables  t'  and  y.  For  a  given  system  with  known  function 

y  (R)  ,  (IV-A-18)  and  (IV-A-19)  derive  the  function  P  (ylt1),  which  appears 
ik  D  1 

in  (IV-A-11)  and  (IV-A-12) . 


In  the  glimpsing  case,  the  probability  of  detection  during  the  j 

unsaturated  period  is  a  function  of  the  number  of  glimpses  during  this 

period.  Accordingly,  the  quantity  d_(y,t)  in  (IV-A-12)  is  replaced  by 

the  quantity  d  (x)  where  x  is  the  number  of  glimpses  in  the  unsatu- 
ij 

rated  period,  d  (x)  is  determined  as  follows, 
ij 

Let  t  >0  represent  the  time  for  a  single  glimpse.  Then, 

Li 


d.  (x)  =  p[detection  in  x  glimpseslt'] 

ij 

r  til  i  « 

•  Plx  glimpses  during  j  unsaturated  period jt  J 

•  P[jth  unsaturated  period  starts  at  t']  •  P  (j-1) 


where  the  last  two  probabilities  are  identical  to  those  appearing  in 

the  definition  of  d.  .  (y,t'). 

1 J 

f*  h 

The  probability  that  there  are  x  glimpses  during  the  jL  unsaturated 
period  is  equivalent  to  the  probability  that  the  length  of  the  jt*1  unsatu¬ 
rated  period  is  such  that 


^  y  <  (x+l)t 


given  that  the  j*'*1  unsaturated  period  commences  at  some  arbitrary  point 
t1.  In  terms  of  the  density  function,  fxu(y)>  this  probability  is: 
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(x+l)t. 


if  t*  +  xt  >  (DI) . 

L  1 


fy  (y>'dyt  if  t'  +  xt  £  (DI)  . 


(IV-A-20) 


The  probability  that  the  detection  occurs  in  x  glimpses,  given  that 
the  unsaturated  period  starts  at  t',  is  given  by 


1 


TTD 1 


-  e.Jf 

xk 


+  “V] 


(IV-A-21) 


where  the  dependence  of  the  functional  value  of  g  (•)  upon  the  starting 

IK 

point  of  the  unsaturated  period  is  made  explicit  by  the  argument.  Clearly, 

the  function  in  (IV-A-21)  is  a  function  of  two  variables:  the  number  of 

glimpses  and  the  starting  point  of  the  unsaturated  period  t'.  For  any 

specified  value  of  x,  the  function  in  (IV-A-21)  is  a  continuous  function 

in  the  variable  t'  over  the  interval  (0,  (DI)  -  xt  ) .  This  fact  will  be 

x  L 

exploited  in  tne  formulation  of  d  (x) . 

Combining  the  foregoing, 


d. .(x) 
ij 


(DI) . -xt 
/*  l  L 

X 

r  (x+1)  t  -l 

f  L 

/  dt'f  (t ' ) 

1  "7T  (1~  gik(t’+ntL)) 

/  fxu<y>dy 

J  Sj 

n=l 

J 

o 

- 

_  xt 

L 

_ 

(j-1) 


(IV-A-22) 
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and 


d 

ij 


y  q.  .m 

x=l 


(IV-A-23) 


where  F(DI)./t  ]  in  (IV-A-23)  signifies  the  largest  integer  that  is  less 

X  JLi 

than  or  at  most  equal  to  the  quantity  in  the  brackets. 

If,  as  discussed  previously,  (DI)^  =  T  ,  a  known  quantity,  then 
(IV-A-22)  and  (IV-A-23)  give  the  desired  probability.  If,  however, 

(DI)^  =  T^(i)  -  t  ,  then  (IV-A-22)  and  (IV-A-23)  must  be  modified  as 
follows . 

The  d,  .(x)  in  (IV-A-22)  becomes  d  .(x,DI)  —  the  subscript  on  the  DI 
tj  ij 

having  been  suppressed — and  d  (x)  is  then  given  by 

PD(j-l)  (IV-A-24) 

where  d  (x,z)  represents  the  value  of  the  expression  within  the  outermost 
ij 

brackets  on  the  right  hand  side  of  (IV-A-22)  and: 


d..  =  7  d. .(x)  .  (IV-A-25) 

ij  L~4  ij 

x=l 


d.  .(x)  = 

13 


T  (i) 
r  T 


f  T_.  (Tm(i)-z)dj  (x,  z)dz 


'i  T 


ij 


The  remainder  of  the  development  proceeds  as  previously  described. 
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B. 


Illustrative  Results 


To  illustrate  the  application  of  the  force  model  a  computer  program 
was  developed  and  the  effectiveness  of  a  representative  ASW  force  deter¬ 
mined. 

The  representative  ASW  force  is  depicted  in  Figure  IV-2.  The  force 
consists  of  a  defended  portion  (unspecified  in  nature),  located  at  (0,0) 
and  proceeding  in  a  direction  parallel  to  the  positive  y-axis,  which  is 
accompanied  by  eight  ASW  units.  The  location  and  direction  of  movement 
of  the  ASW  units  are  shown  in  Figure  IV-2  and  detailed  in  Table  IV-1.  It 
should  be  recalled  that  both  unit  and  stimulus  velocities  are  relative  to 
the  velocity  of  the  defended  force.  Thus,  for  element  1,  a  velocity  of 
0.0  knots  indicates  that  this  element  is  proceeding  at  the  same  pace  as 
the  defended  force.  The  unit  velocity  vectors  shown  in  Figure  IV-2  rep¬ 
resent  only  direction  and  not  velocity.  As  can  be  seen  from  Figure  IV-2 


Table  IV-1 

ASW  UNIT  POSITIONS  AND  VELOCITY  VECTORS 


Unit 

Number 

Position 

Velocity  Vector 

x^ (nmi ) 

.Vj  (nmi) 

9i (deg) 

v^ (knots) 

1 

-20.0 

+70.0 

90 

0.0 

2 

+20.0 

+70.0 

70 

2.0 

3 

-60.0 

+30.0 

100 

1.0 

4 

+60.0 

+30.0 

90 

0.0 

5 

-60.0 

-30.0 

250 

5.0 

6 

+120.0 

-70.0 

150 

5.0 

7 

-40.0 

-60.0 

210 

5.0 

8 

+70.0 

-120.0 

120 

5.0 
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FIGURE  IV-2  REPRESENTATIVE  ASW  FORCE  FOR  MODEL  DEMONSTRATION 


two  units  are  rejoining  the  force  (Nos.  6  and  8);  two  units  are  moving 
toward  a  contact  (Nos.  5  and  7);  and  the  remaining  four  are  arranged  in 
an  advanced  ASW  screen.  To  illustrate  the  versatility  of  the  model  and 
program,  only  two  of  the  units  are  moving  in  the  same  direction  and  at 
the  same  speed  (Nos.  1  and  4). 

For  ease  of  presentation,  the  force  area  of  interest,  (R) ,  is  assumed 
to  be  rectangular  in  nature  and  extending  for  150  nmi  either  side  of  each 
major  coordinate  axis.  The  submarine  weapon  range  consists  of  a  circular 
area  about  the  force  center  with  a  radius  of  25  nmi  which  is  roughly  rep¬ 
resentative  of  possible  cruise  missile  range.  The  .. timuli  are  considered 
to  originate  (initial  appearance)  at  each  of  the  grid  points  contained 
within  the  force  area  of  interest.  In  addition,  each  stimuli  proceeds 
radially  on  an  interception  course  at  a  speed  of  10  knots — all  relative 
to  the  defended  force. 

Each  unit  is  considered  to  contain  a  single  ASW  sensor  of  the  con¬ 
tinuous  looking  type,  hence  expression  (IV-A-12)  fioin  Subsection  A  above 
is  applicable.  The  capability  of  each  sensor  is  considered  to  be  equiv¬ 
alent  and  is  represented  by  a  y 00  of  the  following  form 

Y.,  (R)  =  a  -  bR3 

lk 

which  is  zero  at  R  =  (a/b)^2  and  equal  to  a  at  R  =  0.  For  this  demon¬ 
stration,  the  parameter  values,  a  and  b,  are  assumed  equal  to  0.9900  and 
0.0011,  respectively,  so  that  the  maximum  detection  range  of  the  sensors 

(R*  )  is  30  nmi. 
ik 

Employing  this  functional  form  of  v  (R) ,  the  function  P  (y 1 1 * ) 

i  k  0 

becomes 
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where 


F[c] 


Y..  [R(t)]dt 

lk 


-l 


t'+y 


a 


-J 


X  (t*)  -  X  (t*)  + 

L  s  1 


t(cos  cp  v 
s  s 


-  cos  0 


■iv]' 


+  y.(t*) 

s 


y.  (t*)  +  t(sin  cp  v 
1  s  s 


-  sin  9 


and  the  x  (t*)  and  y  (t*)  of  the  ASW  units  are  assumed  to  be  the  initial 
l  i 

unit  positions  indicated  in  Figure  IV-2. 

The  various  probability  density  functions  which  characterize  system 
performance  are  assumed  to  be  of  the  following  form 


f 

f 

f 


%<x) 

=  P  6(x 
0 

Xu(x) 

t  “Ix 
=  I  e 

Xs(x) 

_  -Bx 
=  B  e 

-Wx 


where  6(x-t  )  is  the  dirac  delta  function.  The  various  parameter  values 
o 

that  specify  these  functions  are:  W  =  0.15/min,  B  =  0.03/min,  I  =  0.01/min, 

and  P  =  0.64  (P  is  the  probability  that  the  system  is  not  saturated  at 
o  o 

time  t  ) . 
o 


The  density  function  f  s(x)  is  found  by  first  determining  the  Laplace 

SJ 

transforms  of  the  convoluted  functions  which  comprise  this  function,  ex¬ 
panding  this  Laplace  transform  by  means  of  partial  fractions,  and  then 
determining  the  inverse  Laplace  transform  of  this  expansion.  This  results 
in 


f  (x) 


f  (X) 

ss 

0 


P  6(x-t  )  +  (1-P  )  W  e 
o  o  o 


-V/x 


j-1 

£ 

m=l 


ni-1  „  m-1 

-lx  x  „  -Bx  x 

A  e  ~ — rrr  +  B  e 


(m-1) 


+  (1-P  )  W 


[  ( I -V 


IB 


o  J_(I-W)(B-W)J 


j-1 


(m-1)  *, 


-Wx 


where 


A  = 


PoClB]J_1(2j-m-3)  (-1)  (j+m_1) 
(B-I)(2j'2"m)  ( j  —2)  (j-m-1) 


+  (-i)(:i+m  1)w(i-p  ) 

o 


B  = 


[iBf -1  g 

P  [lB]j“1(2j-m-3),.(-l)(j+m“1) 
o _ 

(j-2):  (j-m-1) : 


(.H-i-3)'. 


i=l  (j-2)  C  i  -  J) !  (w-l)  (j^"1  1+1,(B-I)<;i+:l  2) 


j-m 


(.1+1-3): 


fel  (j-2)'.(i-l),.(W-B)(j  m"1+1)(i-B)(j+1_2) 


The  results  of  the  model  calculations  are  presented  in  Figure  IV-3 
in  the  form  of  equal  probability  contours  about  the  force  center.  In 
Figure  IV-3  the  initial  positions  of  the  ASW  units  and  the  weapon  rang- 
about  the  defended  force  are  indicated  by  the  encircled  numbers.  In 
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FIGURE  IV-3  ILLUSTRATIVE  FORCE 
EFFECTIVENESS  MODEL 
RESULTS 


'.ddition,  contours  representing  thp  probability  that  the  (M+l)st  stimulus 
will  be  detected  by  at  least  one  of  the  elements  of  the  force  are  shown 
in  the  figure  for  the  0.25,  0.50,  and  0.75  probability  levels. 

While  the  results  shown  in  Figure  IV-3  are  for  illustrative  purposes 
only  and  do  not  represent  the  capability  of  any  specific  force,  they  do 
indicate  the  manner  in  which  the  ASW  coverage  is  reduced  if  units  either 
move  out  to  investigate  contacts  (such  as  element  2)  or  are  detached  to 
prosecute  contacts  (such  as  elements  6  and  8).  These  results  are,  however, 
static  in  one  sense.  That  is,  although  the  kinematics  among  the  units, 
the  force,  and  the  stimuli  are  explicitly  included,  the  progression  of 
time  is  not.  Specifically,  the  detection  capability  afforded  to  the  force 
while  units  6  and  8  proceeded  to  their  present  position  is  not  indicated. 
Thus,  quite  possibly,  a  large  segment  of  the  area  in  the  lower  right  quad¬ 
rant  might  have  been  "swept  -out"  by  these  units  while  in  the  act  of  prose¬ 
cuting  their  contacts.  This  implies  that  a  time  series  of  diagrams  such 
as  Figure  IV-3  would  be  required,  or,  equivalently,  some  continuous  elapsed 
time  representation,  in  order  to  adequately  describe  the  complete  ASW  capa¬ 
bility  of  the  force.  Incorporation  of  this  feature  must  be  the  subject 
of  future  research  efforts.  It  is  possible  that  this  can  be  accomplished 
by  treating  the  various  grid  point  probabilities  as  a  three-dimensional 
Markov  process  (x,  y,  and  probability)  and  investigating  the  character¬ 
istics  of  such  a  process. 

C.  Directions  for  Continued  Methodological  Development 

It  has  been  shown  that  the  ASW  force  effectiveness  model  represents 
the  dynamic  spatial  and  temporal  relationships  of  an  ASW  engagement.  The 
current  stage  of  analytical  development  of  the  force  effectiveness  model 
should  be  extended,  however,  in  order  to  incorporate  more  of  the  dynamic 
aspects  of  the  ASW  engagement.  The  purpose  of  this  subsection  is  to 


IV-33 


briefly  describe  the  next  logical  developmental  steps  necessary  to  increase 
the  dynamic  applicability  of  this  model. 

1 .  Variable  ASW  Unit  Motion 

The  prescribed  ASW  unit  velocity  vectors  should  be  permitted  to 
vary  throughout  the  period  of  interest.  The  point  of  origin  and  length  of 
the  looking  period  in  the  model  are  allowed  to  vary  throughout  the  entire 
range  of  the  permissible  values.  To  make  the  model  more  realistic,  the 
ASW  units  should  be  allowed  to  alter  their  velocity  vectors  during  the 
stimulus  detection  interval,  thereby,  altering  the  probability  of  detec¬ 
tion  versus  range  relationship  to  be  considered;  this  would  necessitate 
including  an  analytical  representation  of  a  partitioning  of  the  variable 
length  sensor  looking  period. 

2.  Intermittent  and/or  Combined  Stimulus  Presence 

The  purpose  of  this  development  is  to  introduce  into  the  present 
mo't.  the  effects  on  possible  target  detection  due  to  either  intermittent 
stimulus  presence  or  multiple  target  stimuli.  During  the  development  of 
the  force  effectiveness  model,  the  type  of  sensor  considered  was  not  made 
explicit,  and,  accordingly,  it  was  assumed  that  the  stimulus  of  concern 
was  present  throughout  the  entire  period  of  detection  opportunity.  Yet, 
when  specific  sensor  types  are  considered,  questions  regarding  stimulus 
presence  and  the  manner  of  operation  become  important  because  of  the 
implicit  sensor  stimulus  relationship.  For  example,  if  the  specific 
ASW  sensor  to  be  considered  is  a  periscope  detecting  radar,  this  sensor 
can  be  effective  only  during  periscope  exposure.  Hence,  when  evaluating 
the  potential  contribution  of  this  type  of  sensor  to  the  overall  force 
effectiveness,  it  is  necessary  to  consider  whether  or  not  the  appropriate 
stimulus  will  be  present,  and,  if  so,  when  and  for  how  long  a  period. 


Insofar  as  the  total  force  detection  effectiveness  is  concerned, 
there  is  no  requirement  that  detection  be  accomplished  by  any  one  specific 
sensor  type.  In  fact,  supporting  detections,  particularly  by  different 
sensor  types,  contribute  greatly  to  overall  force  effectiveness.  With 
regard  to  this  last  point,  nonsub  phenomena  seldom  exhibit  multiple 
characteristics  similar  to  those  of  an  actual  submarine  target. 

The  implications  of  introducing  these  two  contingencies,  inter¬ 
mittent  and  combined  stimulus  presence,  into  the  model  are:  (1)  the 
present  detection  methodology  must  be  modified  so  as  to  reflect  the  inter¬ 
action  between  stimulus  presence  and  the  sensor  unsaturated,  periods  for  at 
least  those  force  sensors  deemed  to  be  most  relevant  to  force  effective¬ 
ness;  and,  (2)  the  overall  force  effectiveness  model  will  likely  have  to 
be  restructured  in  the  form  of  a  network  that  combines  the  effects  and 
results  of  each  of  the  individual  sensor  models. 

3 .  Intermittent  Sensor  Operation 

Intermittent  sensor  operation  is  the  unit  counterpart  to  the 
intermittent  stimulus  presence  discussed  above.  There  are  ASW  sensors, 
most  notably  the  helicopter  dipping  sonar,  which  are  operated  in  an  inter¬ 
mittent  manner.  The  conditions  surrounding  the  effective  operation  of 
these  sensor  types  are  often  complicated  by  the  large  sensor  relocation 
distances  which  can  occur  between  successive  search  periods.  The  incor¬ 
poration  of  the  effects  of  intermittent  sensor  operation  will  require  a 
modification  to  the  present  detection  methodology  similar  to  that  de¬ 
scribed  in  IV-C-2  above. 

4 .  Contact  Hand-off  Process 

Contact  hand-off  process  should  be  incorporated  in  the  ASW  force 
model.  Two  levels  of  this  hand-off  process  must  be  considered.  These  are 
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•  The  hand-off  or  transfer  of  contacts  between  units  of 
the  ASW  force.  An  example  of  this  is  the  transfer  of 
surface  escort  active  sonar  contact  to  the  helicopter 
such  as  the  light  airborne  multipurpose  systems  (LAMPS) 
that  conduct  the  final  localization,  attack  and  kill 
functions . 

•  The  hand-off  of  contact  to  the  ASW  force  from  surveil¬ 
lance  systems  external  to  the  ASW  force.  An  example  of 
this  is  the  transfer  of  the  fixed  site  acoustic  sur- 
veilance  system's  (SOSUS)  contact  to  the  ASW  force. 

The  first  of  the  above  has  been  discussed  in  Section  III-E-3.  The  incor¬ 
poration  of  the  second  hand-off  process  will  come  about  during  the  formu¬ 
lation  and  implementation  of  the  command  and  control  function  within  the 
ASW  Force  queuing  model.  Hand-off  process  will  influence  the  priority 
assignments  given  to  contacts  that  are  already  in  the  queue  and  awaiting 
attention. 

5 .  Other  Areas  for  Analysis 

There  are  other  operational  procedures  which  must  ultimately 
be  incorporated  into  the  model  if  the  methodology  is  to  be  complete.  How¬ 
ever,  many  of  the  circumstances  surrounding  these  procedures  have  not  as 
yet  been  investigated,  and,  therefore,  the  methodological  implications  are 
unclear.  The  areas  of  analysis  associated  with  these  operational  proce¬ 
dures  are  listed  here,  without  description,  for  the  purpose  of  indicating 
the  probable  direction  of  future  methodological  development: 

•  Effect  of  loss  of  contact  and  regain  contact  procedures 

•  Contact  conversion:  procedures  for  transfer  of  contact 
from  detection  stimulus  source  to  prosecution  stimulus 
source 

•  Effect  of  variable  stimulus  motion  (this  problem  may 

be  encountered  and  examined  when  the  problem  of  variable 
ASW  unit  motion  is  investigated). 
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Appendix  A 

FLOW  GRAPHS  AND  SEMI-MARKOV  PROCESSES 
ASSOCIATED  WITH  A  MULTIPLE  PHASE  QUEUING  SYSTEM 

1 .  Transition  Rate  Diagrams 

In  the  body  of  this  report  a  particular  type  of  directed  graph,  known 
as  a  transition  rate  diagram  in  Markov  process  theory,  was  introduced  to 
represent  states,  and  transitions  between  these  states,  in  a  multiple  phas 
queuing  system  having  exponential  holding  times  and  interarrival  times. 

As  pointed  out  there,  more  general  holding  and  interarrival  times  can  be 
considered  by  replacing  nodes  of  the  graph  with  appropriate  subnetworks. 

The  concept  of  a  flow  graph  is  associable  more  generally  with  Markov 
and  semi-Markov  processes,  of  which  this  queuing  situation  is  a  special 
case.  It  is  a  common  procedure  in  queuing  analysis  to  "embed"  a  Markov 
process  in  the  system  being  analyzed — that  is,  to  visualize,  as . the  heart 
of  the  system,  a  Markov  process  of  the  appropriate  sort.  Many  of  the 
results  available  on  M/Gl  and  GI/M/m  queues  are  obtained  using  this  ap¬ 
proach.  In  the  type  of  queuing  model  under  study  in  this  project,  how¬ 
ever,  a  lot  more  can  be  obtained  using  embedded  Markov  processes  as 
exponential  distributions  are  assumed  throughout  the  network.  In  fact, 
the  queuing  model  as  formulated  in  Sections  ITI-A  and  III-B,  when  viewed 
from  the  proper  perspective,  is  nothing  less  than  a  continuous  time  Markov 
process.  Also,  certain  results  on  semi-Markov  processes  are  useful  for 
interpretive  purposes. 

Markov  and  semi-Markov  processes  have  been  frequently  employed  to 

1  7 

model  stochastic  aspects  of  dynamic  systems,  particularly  in  mili¬ 

tary  systems  analysis.  The  application  of  flow  graphs  results  in  the 
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formulation  of  a  unifying  approach  to  an  otherwise  very  complex  situation, 
as  well  as  providing  considerable  generality  and  flexibility. 


2 .  Markov  and  Semi-Markov  Processes 

In  a  Markov  process,  the  transition  times  between  states  are  all 
exponentially  distributed  and  depend  only  on  the  state  from  which  each 
transition  originates.  Basically,  a  Markov  process  is  specified  by: 

a.  Transition  probabilities  p^  =  Prob(pass  from  state  i  to 
state  j) 

b.  Holding  rates  X-^  ,  with  ProbCstay  in  ^ 

state  i  at  least  time  t  before  transition)  =  e  1 


A  semi-Markov  process,  then,  is  specified  by: 

a.  Transition  probabilities  pjj  =  Prob(pass  from  state  i  to  state  j) 

b.  Holding  time  probability  densities  hii(t)  =  Prob(time  in  state  i 

will  pass  from  state  i  to  state  j), 


Thus,  a  Markov  process  is  clearly  a  special  case  of  a  semi-Markov  process. 


Before  it  can  be  shown  how  the  specific  problem  of  this  report  is 
related  to  Markov  and  semi-Markov  processes,  one  other  concept  used  in 
semi-Markov  and  Markov  theory  must  be  discussed. 


3 .  Competing  Processes 

Semi-Markov  processes  can  be  interpreted  as  processes  in  which  a 
"race"  is  taking  place  between  independent  stochastic  processes,  each 
one  governing  the  time  that  a  transition  will  take  from  a  state  i  to 
some  state  j,  given  the  system  is  in  state  i  at  time  zero.  This  is 

g 

referred  to  as  a  competing  process  model.  The  assumption  is  made  in 
this  model  that  whenever  "something  happens,"  i.e.,  the  system  makes  a 
transition,  all  the  appropriate  "competing  processes"  are  reset  like 
clocks  and  the  first  one  that  "rings  an  alarm"  is  the  one  that  determines 
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the  next  transition.  This  "race"  interpretation  is  based  on  defining: 


gik (t)  =  Prob (successor  state  to  state  i  is  state  k,  at  time  tj 
competition  started  at  time  0). 

Then  there  exist  integral  formulas6  expressing  h^^CtJ's  and  p.  .’s  in  term 
of  the  given  gik(t)'s.  Similarly,  given  the  hjjCtVs  and  p^'s,  it  is 
possible  to  define  the  gik(t)'s  by  implicit  formulas,  but  in  general  these 
cannot  be  solved  explicitly. 

It  turns  out  that  a  Markov  process  is  the  particular  case  of  a  semi- 
Markov  process  for  which  the  competing  processes  are  all  exponentially 
distributed ,  i.e., 


-X.  t 

g.,  (t)  =  X  e  ik  ,  t  ^  0  .  (A-l) 

lk  ik 

It  is  this  fact  that  is  of  great  value  in  the  study  of  the  multiple  phase 
queuing  system  considered  hero.  In  fact,  the  servers  and  "arrival  con¬ 
troller"  of  the  ASW  queuing  system  can  be  interpreted  as  "competing  pro¬ 
cesses"  which  operate  independently  and  govern  the  state  transitions  in 
the  total  network  repi’esented  by  Figures  III-4  to  II1-8.  The  \k's  are 
therefore  all  equal  to  one  of  the  five  quantities  X,  p2>  p^,  p^. 

4 .  Multiple  Phase  Service  Queuing  in  Terms  of  Competing  Processes 

Using  the  "competing  process"  interpretation,  any  multiple  phase 
service  queuing  system,  and  in  particular  the  single  element  model,  can 
be  regarded  as  a  Markov  process  in  the  following  way : 

Take  as  the  states  of  the  Markov  or  semi-Markov  process  the  states 
described  in  Section  III-B.  Then  declare  the  arrivals  and  services  to 
be  competing  processes.  In  the  standard  notation,6  a  transition  proba¬ 
bility  matrix  P  is  thus  obtained  with  entries 


i  ^  3 


,  i  =  J 


(A-2 ) 


where  N  is  the  total  number  of  states.  In  the  ASW  single  element  case, 
the  X^'s  are  always  one  of  the  quantities  X,  P2,  n3,  \i  ,  depending 
upon  what  the  "competing  process"  creates  the  transition  from  i  to  j ,  or 
else  Xjj  is  0  if  there  is  no  such  transition.  Similarly,  in  the  standard 
notation,  the  holding  rates  are 


A 

i 


N 

X 

ij 

j^i 


E 


the  holding  rate  (diagonal)  matrix  is 


A  =  diag  (X  ) 

and  the  transition  rate  matrix  A  with 

i  r  j 

i  =  j 

a 


is  related  to  A  and  P  by 


(A-3) 


(A-4) 


(A-5) 


A  =  A  (P~I) 


(A-6) 


where  I  is  the  NxN  identity  matrix. 


The  model  becomes  a  semi-Markov  process  when  the  arrivals  or  services 
are  not  exponential.  However,  by  substituting  suitable  finite  subnetworks 
of  exponential  servers  for  the  state  nodes  to  approximate  the  arrival  or 
service  holding  behavior,  a  Markov  process  can  again  be  produced,  although 
at  the  expense  of  an  enlarged  number  of  states. 


5.  Flow  Graphs  for  Markov  and  Semi-Markov  Processes 
a.  Flow  Graphs 

Flow  graphs  are  particularly  interpreted  directed  graphs  asso- 
ciated  with  systems  of  linear  equations.  They  were  originally  invented 
in  signal  flow  theory  of  electrical  engineering,  and  later  worked  their 
way  into  other  areas,  such  as  Markov  and  semi-Markov  processes5’6’9  and 
queuing  theory. 

A  flow  graph  for  a  system  of  linear  equations 
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a.  x 
'  ij  J 


=  x 


i=l, . . . ,N 


(A-7) 


is  interpreted  as  a  network  having  nodes  corresponding  to  the  state  vari¬ 
ables  x^  and  having  arcs  labeled  by  ajj  directed  from  j  to  i  for  every 
nonzero  a^j  (see  Figure  A-l).  Note  that  the  matrix  A-I  has  to  be  singular 
in  order  that  the  above  equations  can  have  a  non-trivial  solution.  Thus, 
given  a  network  with  labels  a4 i  on  its  (directed)  arcs,  the  system  of  equa- 
tions  it  represents  is  always  taken  as  the  relations  stating  that  each 
node's  state  variable  x^  is  obtained  as  the  sum  of  adjacent  state  variables 
x.  at  the  tails  of  branches  terminating  at  multiplied  by  the  arc 

•J 

weights  ajj  of  these  branches,  where  j  may  possibly  equal  i.  When  j=i, 
this  corresponds  to  a  self-loop  at  node  i  (see  Figure  A-l). 
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X1  =  311  X1  +  a12X2  +  a13X3 
x2  =  a21x1 
x3  =  a34X4 
x4  =  a42  X2 


FIGURE  A-1  TYPICAL  FLOW  GRAPH  AND  CORRESPONDING  EQUATIONS 

The  linear  equations  represented  by  a  flow  graph  can  involve 
scalars,  vectors,  matrices,  Laplace  transforms,  or  matrices  of  Laplace 
transforms.  As  will  bo  shown  later,  all  four  types  will  be  useful  in 
studying  multiple  phase  queuing  systems  and  Markov  or  semi-Markov  pro¬ 
cesses  in  general. 

g 

Matrix  flow  graphs  often  provide  a  concise  representation, 
especially  when  flow  graphs  are  reducible  to  block  form,  in  which  it  makes 
sense  to  distinguish  between  transitions  within  and  between  blocks  of 
states . 5 


b.  Transmission  Through  a  Flow  Graph 

In  flow  graph  theory  there  is  the  concept  of  "transmission"  or 
"flow"  through  a  flow  graph  having  a  pair  of  nodes  singled  out  as  "input" 
and  "output"  nodes.  These  are,  of  course,  nodes  that  have  only  arcs 
leaving,  or  ,->ntering,  respectively,  with  respect  to  the  remainder  of 
the  flow  graph  (see  Figure  A-2).  The  motivation  for  the  term  "transmis¬ 
sion"  lies  in  signal  flow  graph  theory;  the  formal  definition  is  as 
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follows  : 


FIGURE  A-2  transmission  through  a  flow  graph 

Definition :  Suppose  that  all  variables  except  two  particular 
ones  in  a  flow  graph  have  been  algebraically  eliminated,  leaving  one  of 
these,  referred  to  as  the  output  variable,  expressed  as  a  factor  tines 
the  other  one,  referred  to  as  the  input  variable.  Then  this  factor  is 
referred  to  as  the  transmission  of  the  flow  graph  from  the  designated 
input  node  to  the  designated  output  node. 


C’  Reduction  and  Equivalency  of  Flow  Graphs 

In  the  theory  of  flow  graphs,  there  is  an'  entire  body  of  knowl¬ 
edge  concerning  reduction  of  flow  graphs  and  equivaieney  of  flow  graphs 

Two  flow  graphs  are  said  to  be  equivalent,  with  respect  to  a  set  of  input 

and  output  nodes,  if  they  have  the  sane  transmission  between  these  nodes. 

•Nodes  in  a  natrix  flow  graph  are  vectors,  and  thereby  rep.  .-sent  sets  of 

nodes  having  scalars  associated  with  them.  The  reduction  techniques 

developed  in  signal  flow  theory  were  intended  primarily  for  reducing  flow 

graphs  to  a  single  arc  from  input  to  output  so  that  the  transmission 
could  be  calculated. 


d. 


The  steady-state,  or  equilibrium,  equations  of  a  Markov  process 
with  transition  probability  matrix  P  and  transition  rate  matrix  A  (see 
Section  4  of  this  appendix)  are  obtained  from  the  dynamic  equations  (see 
Section  e  below)  by  setting  derivatives  equal  to  zero.  This  results  in 
the  matrix  equation  pA  =  0,  i.e. , 

N 

A.P.  =  YV.PA.  i=l,2,...,N  (A -8) 

11  Ji  J  J 

where  p  =  (p^ »P£ > • • • »P^)  is  a  row  vector  of  steady  state  probabilities 

p  =  Prob(system  is  in  state  i  in  steady  state)  (A-9) 

i 

assuming  a  steady-state  exists.  The  flow  graph  for  the  above  equations 
is  given  by  Figure  A-3.  Note  that  the  general  ati  of  Figure  A-2  con- 

A- J 

tains  the  factor  p..  here,  and  so  the  p. .  arc  is  directed  from  i  to  j , 

J1 

and  not  from  j  to  i. 


REMAINDER  OF  FLOW  GRAPH 


FIGURE  A-3  STEADY-STATE  FLOW  GRAPH  OF  A  MARKOV  PROCESS 


e.  Dynamic  Flow  Graph  of  a  Markov  Process 


In  order  to  obtain  a  flow  graph  for  a  Markov  process  in  the 
transient  state,  we  must  have  a  system  of  linear  equations  for  this  case, 
which  is  convenient  to  write  in  terms  of  Laplace  transforms,  and  is  given 
by 


* 

cp.  .(s) 

ij 


6.  . 

s  ■  +  X. 


A  PikXk  * 

V  1  ■  v-  cp,  .(s) 
La  s  +  X,  kj 
k=l  k 


(A-10) 


where  cp^  (s)  is  the  Laplace  transform  of  the  function  cp  (t)  given  by 
ij  ij 


cp  (t)  =  Prob(system  in  state  j  at  time  t  in  state  i  at  time  0)  ,  (A-ll) 

'  -i  -5 


6^  is  the  Kroenecker  delta  function,  and  the  p^'s  and  Xk's  are  as  in¬ 
troduced  in  Sections  2  and  3  of  this  appendix. 

In  matrix  form,  the  above  equation  may  be  written  as 

s§  (s)  =  I  (s)A  (A-12) 


where  A  is  defined  by  (A-6).  Thus  we  have  the  matrix  flow  graph  of 
Figure  A-4  whose  transmission,  from  an  input  vector  of  initial  states 
to  an  output  vector  of  terminal  states,  is  a  matrix  of  Laplace  transforms 
given  by 

T  =  (si  -  A)-1 


(A-13) 


The  splitting  of  T  into  the  above  two  factors  explains  the  matrix  self¬ 
loop  in  Figure  A-4.  The  reason  for  resorting  to  this  form  is  that  it 
leads  to  a  method  of  employing  the  coefficients  of  the  matrix  A  directly. 

We  cannot  delve  in  depth  into  the  general  theory  of  flow  graphs  here, 

but  will  merely  point  out  that  self-loops  with  transmission  G  are  commonly 

used  to  represent  a  "through"  transmission  equal  to  (I-G)-1  (see  Refs.  5,6). 


A-ll 


INPUT 


OUTPUT 


FIGURE  A-4  MATRIX  LAPLACE  TRANSFORM  FLOW  GRAPH 
FOR  A  MARKOV  PROCESS 


The  flow  graph  in  Figure  A-4  is  useful  from  the  theoretical  stand¬ 
point,  but  for  computations  it  must  be  broken  down  to  a  representation  by 
components,  as  in  Figure  A-5.  Note  that  in  Figure  A-5  there  is  a  scalar 
input,  i.e.,  the  flow  graph  is  entered  externally  at  a  single  node,  in 

order  that  the  individual  transmissions  <pf.(s)  to  the  respective  nodes 

■t  J 

may  be  computed,  which  yield  the  desired  probability  density  functions 


REMAINDER  OF  FLOW  GRAPH 
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FIGURE  A-5  SCALAR  LAPLACE  TRANSFORM  FLOW  GRAPH  FOR  A  MARKOV  PROCESS 
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* 

^ - 1-— a" ttif - - 


^ij  uP°n  inversion  of  their  transforms.  Taking  the  input  to  the  flow 
graph  as  node  i  corresponds  to  setting  the  initial  conditions  for 
^ij  (°)  =  ^ij  in  the  corresponding  time  domain  equation 

<p(t)  =  cp(t)A  (A-14) 


of  the  Markov  process;  that  is,  cp±J  (0)  =  6  is  the  condition  that  ini¬ 
tially  the  system  is  in  state  i,  which  is  required  in  the  definition  of 
<P.  ■ (t). 

In  Figure  A-5  the  state  variables  at  the  nodes  i  are  the 

quantities 


x  =  scp* 

J  ij 


(A-15) 


which  are  Laplace  transforms  of  the  derivatives  of  the  desired  probability 

distributions.  The  flow  graph  for  the  Markov  process  has  been  drawn  with 

these  state  variables  by  Howard,6  and  with  the  cp*.'s  themselves  by  Gue.9 

^  J 

Using 

the  only  modification  to  Figure  A-5  would  be  a  factor  of  1/s  on  the  input 
arrow  and  a  unity  factor  on  the  output  arrows.  The  main  point,  however, 
is  that  the  transmission  from  the  input  to  each  output  is  always  the 
Laplace  transform  of  the  desired  probability  density  function,  regardless 
what  equivalent  network  lies  between.  For  computation  by  flow  graph  re¬ 
duction  techniques,  the  manner  of  choosing  state  variables  may  be  impor¬ 
tant  from  the  computational  standpoint.  Howard6  makes  a  great  point  of 
this  in  his  treatment  of  flow  graphs  for  particular  probability  distribu¬ 
tions  and  he  emphasizes  the  use  of  what  he  refers  to  as  the  semi-Markov 
flow  graph  for  a  Markov  process,  which  is  discussed  below. 
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f . 


Dynamic  Flow  Graph  of  a  Semi-Markov  Process 


The  dynamic  equations  of  a  semi-Markov  process,  with  state 
variables  and  parameters  as  defined  in  Section  5e  of  this  appendix,  are 
given,  in  terms  of  their  Laplace  transforms,  by 


* 

$ .  .(s) 
ij 


(A- 17) 


where  cp^  has  the  same  meaning  as  for  a  Markov  process,  and: 


> 


(t)  =  Prob(amount  of  time  system  stays  in  state  i  exceeds 

i 

t| system  in  i  at  time  0) 


(A-18) 


-X.t 

=  e  in  the  Markov  case 

Howard's  flow  graph6  for  the  above  equation  appears  in  Figure  A-6  in 
matrix  form,  and  in  Figure  A-7  in  scalar  form. 


It  will  be  observed  from  comparison  of  Figures  A-4  with  A-6 
and  A-5  with  \-7  that  the  state  variables  do  not  correspond  in  these  two 
cases.  In  Figure  A-7,  the  state  variables  are  actually 


which  reduces  to 


x 

j 


1 

w  ,(s) 
J 


<p*.(s) 

1J 


(A-19) 


x.  =  (s  +  \  .  (s)  (A-20) 

J  J  iJ 
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FIGURE  A-7  SCALAR  LAPLACE  TRANSFORM  FLOW  GRAPH  FOR  A  SEMI-MARKOV  PROCESS 


J _ _ 


in  the  Markov  case  while,  as  was  seen  earlier,  the  Markov  flow  diagram 
has : 

x.  =  scp*.(s)  .  (A -21) 

3  ij 

The  reason  for  this  discrepancy  is  that  Markov  flow  graphs  have  been 
conveniently  based  on  the  A  matrix  because  it  totally  describes  the 
process.  Since  no  such  simple  representation  exists  for  a  semi-Markov 
process,  the  semi-Markov  flow  graphs  have  been  based  on  the  P  and  H 

g 

matrices.  As  Howard  points  out,  the  semi-Markov  flow  graph  of  a  Markov 
process  has  the  advantage  that  it  has  no  self-loops  when  the  P-j^'s  are 
all  0,  which  is  often  the  case  (as  it  is  in  this  application).  Thus, 
hand  computations  by  flow  graph  reduction  techniques  are  aided  by  resort¬ 
ing  to  this  approach.  The  special  case  of  Figure  A- 7  takes  the  form  of 
Figure  A-8  when  we  have  a  Markov  process. 

When  a  Markov  process  is  expressed  in  terms  of  competing  pro¬ 
cesses  as  in  Section  3,  the  arc  factors  in  Figure  A-8  take  the  form: 

X 

i 

Pij  s  +  X. 

i 

Thus,  in  the  single  element  model,  these  will  be  of  the  form: 


s  +  X  +  u,  +  u,  +u,  +  u.  ,  etc.  (A-23) 

'1  2  3  4 

The  value  of  semi-Markov  type  flow  graphs  is  not  just  to  b.e 
able  to  eliminate  self-loops  in  certain  types  of  Markov  flow  graphs. 
Setting  up  semi-Markov  flow  graphs  for  queuing  systems  can  be  of  direct 


ij 


s  + 


N 

E 

j=i 


(A-22) 
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REMAINDER  OF  FLOW  GRAPH 


FIGURE  A-8  SEMI-MARKOV  FLOW  GRAPH  FOR  A  MARKOV  PROCESS 

value  in  numerical  computation,  when  services  and  arrivals  are  not  expo¬ 
nential  (see  Section  III-E). 

6 .  Using  Semi-Markov  Flow  Graphs  to  Compute  Probability  Distributions 
lor  State  Occupancy  Times 


Suppose  it  is  desired  to  know  the  probability  distribution  for  the 
amount  of  time  spent  between  entering  and  exiting  a  particular  subset  S 
ol  the  set  oi  states  in  a  Markov  or  semi-Markov  process.  This  problem 
can  be  approached  from  the  point  of  view  of  flow  graph  theory.  Consider 
the  subgraph  of  the  semi-Markov  flow  graph  for  the  given  process  con¬ 
sisting  of  only  the  nodes  in  S  and  all  arcs  interconnecting  these  nodes. 
Recall  that  the  flow  factors  on  the  arcs  here  are  Laplace  transforms  of 
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FIGURE  A- 9a  SEMI-MARKOV  FLOW  GRAPH  FOR  TIME  SPENT  IN  A  SUBSET  S  OF  STATES 


the  corresponding  transition  probabilities.  Now  add  on  all  incoming 
arcs  to  S  from  the  complementary  set  of  states  S  and  join  their  tails 
at  a  fictitious  source  node  labeled  "INPUT,”  but,  instead  of  having  the 
original  Laplace  transforms  associated  with  these  arcs,  designate  them 
with  the  (normalized)  steady-state  probabilities  of  the  states  to  which 
they  lead.  Next,  replace  all  outgoing  arcs  from  set  S  by  arcs  to  a 
fictitious  node  labeled  "OUTPUT,"  and,  in  this  case,  multiply  the  original 
Laplace  transforms  on  these  arcs  by  the  term  1/s  (see  Figure  A-9a) . 

It  will  not  be  demonstrated  that  the  desired  cumulative  probability  dis¬ 
tribution  is  obtained  as  the  inverse  Laplace  transform  of  the  transmission 
of  this  flow  graph  from  its  input  to  its  output. 

Consider  what  happens  when  the  system  has  just  entered  one  of  the 
states  of  the  subset  S  from  the  complementary  set  of  states  S.  Given  no 
further  information,  it  can  only  be  said  that  tl.^  (discrete)  probability 
density  for  starting  out  consists  of  just  the  steady  state  (equilibrium) 
probabilities  for  the  states  entered  from  elsewhere  in  the  flow  graph 
only,  that  is,  those  states  which  have  a  non-zero  transition  probability 
to  them.  Once  the  system  is  in  one  of  the  states  of  S,  it  spends  an 
amount  of  time  t  or  less  in  S  if,  and  only  if,  it  reaches  some  state  in 
S  by  time  t  (for  every  t  >  0).  Thus,  the  desired  c’  -ilati^e  probability 
distribution  is  clearly  the  sum  over  all  possible  initial  states  i  of  S 
and  all  possible  adjacent  states  j  in  S,  of  the  terms: 

P (system  is  in  state  i  of  S  and  takes  time  t  to  reach  state 

j |system  begins  its  stay  in  state  i)  •  P (system  starts  out 

in  state  x^)  (A-24) 


The  reason  we  do  not  take  arcs  from  the  "INPUT"  node  to  all  nodes  of 
S  is  that  we  are  interested  only  in  those  states  of  S  at  which  we 
could  have  just  arrived  from  the  complement  S,  and  these  are  not 
necessarily  all  nodes  of  S. 
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Now,  the  transmission  of  a  semi-Markov  flow  graph  from  a  node  i  to  a 
node  j  is,  by  definition  the  quantity: 

=  Lap.  transf.  of  P (system  is  in  state  j  at  time  t|in 

i  at  t  =  0).  (A-25) 

Consider  a  modified  flow  graph  of  Figure  A-9a,  given  in  Figure  A-9b, 
containing  direct  representations  of  the  adjacent  states  j  in  S  which 
are  exited  into  upon  leaving  S.  The  interpretation  of  this  new  flow  graph 
is  that  we  now  have  expanded  S  to  include  its  adjacent  exit  states  which 
are  now  made  to  be  so-called  "trapping"  states6  by  the  omission  of  all 
arcs  emanating  from  them  (including  those  to  each  other).  Thus,  when 
the  transmission  through  the  flow  graph  of  Figure  A-9b  is  computed,  the 
Laplace  transform  of  the  probability  of  reaching  any  one  of  these  trapping 
states  by  time  t  is  obtained,  i.e.,  the  above  sum  of  terms.  Since  this 
is  the  sum  of  transmissions  to  the  trapping  state  nodes  multiplied  by 
1/s,  Figures  A-9a  and  A-9b  are  equivalent.  Note  that  the  output  arcs  in 
Figure  A-9b  have  the  factor  1/s  only,  not  l/(s  +  X^),  since  the  transi¬ 
tion  rates  X.  for  these  states  have  been  set  equal  to  zero.  Consequently, 
the  above  sum  is  just  the  inverse  Laplace  transform  of  the  transmission 
from  input  to  output  for  either  equivalent  flow  graph  of  Figures  A-9a  or 
A-9b.  This  result  is  used  in  Sections  IV-C  and  IV-D  to  represent  and 
calculate  saturated,  unsaturated,  and  waiting  time  distributions  for  the 
single  element  AS'V  model.  Note  that  the  probability  density  function, 
instead  of  the  cumulative  function,  is  obtaii. .  by  omitting  the  1/s 
factors  on  the  output  arcs. 
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FIGURE  A-9b  EQUIVALENT  FLOW  GRAPH  FOR  TIME  SPENT  IN  A  SUBSET  S  OF  STATES 
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SOLVING  THE  SYSTEM  PROBABILITY  EQUATIONS 
IN  THE  TRANSIENT  STATE 

In  this  appendix  a  suitable  system  of  differential  equations  for  cal¬ 
culations  of  the  desired  cumulative  probability  equations,  as  functions  of 
time,  is  developed.  The  general  idea  behind  the  "successive  overrelaxa¬ 
tion  iterative  method,”10  employed  to  compute  solutions  to  these  equations, 
is  explained  and  this  explanation  is  followed  by  a  description  of  how 
graphtheoretical  considerations  led  to  great  reduction  in  computing  storage 
and  number  of  operations  required.  The  description  will  be  with  reference 
to  Figure  III-13,  but  the  same  overall  approach  was  used  for  the  other 
measures  of  effectiveness. 


1 .  The  Differential  Equations 

As  in  Appendix  A,  the  system  of  differential  equations  to  be  solved 
in  finding  the  probability  distribution  for  the  time  t  that  a  Markov  pro¬ 
cess  takes  to  reach  a  set  of  trapping  states  S  is  represented  by  the 

o 

matrix  differential  equation  (A-14) 

cp(t)  =  cp(t)A 


where  A  =  'a  ]  is  the  transition  rale  matrix  of  the  appropriate  Markov 

ij 

process  and  is  formed  from  a  transition  probability  matrix  P  and  a  holding 
rate  (diagonal)  matrix  A  through  the  formula  A  =  A(P  -  I).  These  must 
also  be  associated  with  Figure  III-13,  but  not  the  entire  system,  when 
considering  system  unsalurated  time.  These  matrices  in  turn  are  obtain- 


4* 


from  the  (assumed)  independent  "servers"  comprising  the  queuing  system, 
and  are  always  equal  to  one  of  the  quantities  >,  u,,  ...  ,  ,  or  multi¬ 

ples  thereof. 

The  desired  probability  distribution  for  unsaturated  time  is  the 
quanti  ty 


C  2  piV*>/  1C 


(B-l) 


ieST  jeS 


where  S  and  S  are  the  appropriate  sets  of  input  and  output  (absorbing) 

I  0 

states,  p  is  the  steady  state  probability  of  state  i  ,  defined  by  Equa- 
i 

tion  (A-9)  in  Appendix  A,  and  cp.  .  is  defined  by  (A-ll). 

t  J 

With  reference  to  the  general  discussion  of  Appendix  A,  the  appropri¬ 
ate  input  states  for  calculating  system  unsaturated  time  are  the  states 
with  exactly  3  contacts  in  the  system.  That  is,  when  the  system  enters 
an  unsaturated  condition,  the  number  of  contacts  must  have  just  changed 
from  1  to  3.  Lacking  any  a  priori  information,  the  probability  that  any 
one  of  the  substates  in  Figure  III-7  is  the  one  the  system  just  entered 
since  becoming  unsaturated  is  just  the  steady  state  probability  of  that 
state  divided  by  the  sum  of  steady  state  probabilities  for  the  3  in-the- 
system  states.  Similar  considerations  lead  to  the  designation  of  the 
appropriate  output  states  for  calculating  system  unsaturated  time  as  the 
states  with  exactly  4  contacts  in  the  system. 


The  quantity  (B-l)  is  obtainable  by  starting  off  the  integration  of 


the  system  of  differential  equations 


t, 

v 


j=i 


i  =  1,  2, 


wich  the  initial  conditions 


(B-2) 


(B-3) 


and  summing  up  the  output  state  values  to  form; 


x0(t) 


E  v« 


(B-4) 


Equations  (B-2.)  are  the  expanded  form  of  the  matrix  differential 
equation  (A-ld),  i.e.,  cp  =  cpA  ,  which  has  <p  interpreted  as  a  row  vector 
to  maintain  conformity  with  Reference  6.  To  relate  the  following  develop¬ 
ments  to  Reference  10,  it  is  necessary  to  realize  that  here  we  have  the 
transpose  of  every  matrix  and  vector  employed  in  Reference  10. 

The  matrix  A  may  be  decomposed  into  lower  and  upper  triangular  and 
diagonal  portions,  because  of  the  particular  flow-graph  structure  of  the 
model  which  allows  grouping  of  nodes  with  1 , 2, 3, . . . , etc. ,  contacts  in  the 
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system.  Furthermore,  this  decomposition  of  the  matrix  A  is  in  a  block 
diagonal  form,  having  three  "diagonals"  of  blocks  of  matrices,  namely 
those  corresponding  to: 


i  arrivals 

ii  exits  from  the  system,  and 

iii  completions  of  services  at  the  interim  queues  within  the  system. 

This  structure  is  depicted  in  Figure  B-l,  for  the  case  of  unsaturated 
system  time  calculation. 

Referring  to  Appendix  A,  the  entries  a  of  the  matrix  A  are  just 

ij 

the  appropriate  "competing  process"  parameters  \  off  the  diagonal,  and 

ij 

minus  the  sum  of  all  off-diagonals  i  's  on  the  diagonal.  In  our  model, 

ij 

it  will  be  recalled  that  these  i . ,'s  are  always  >  or  multiples  of  one 

i  J 

of  the  u  's  ,  (i=l  to  4).  The  actual  details  of  the  block  matrix  A 

i  ^ 

in  Figure  B-l  are  given  in  Figure  B-2.  The  diagonal  terms  are  not  in¬ 
cluded  for  the  sake  of  simplicity,  as  they  are  rather  long  to  write,  but 

the  very  first  one,  for  example,  would  be  -  \  -  2u,  -  u 

1  4 
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BLOCK 

DIAGONAL  STRUCTURE  OF  THE  ONE  MATRIX  A 

B-6 


FIGURE  B-2  DETAILS  OF  ONE  BLOCK  MATRIX  IN  FIGURE  B-1 


2 .  The  Successive  Overrelaxation  Iterative  Method1^ 

The  following  procedure  is  a  convergent  scheme  for  solving  a  system 
of  linear  equations  of  the  form 


vQ  =  g 


(B-5) 


where  v,g  are  row  vectors 

v  =  Cvx,  vn}  ,  g  =  {g^  g  }  (B-6) 
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and  Q  is  an  N  X  N  matrix  which  satisfies  certain  properties  set  out  in 
Reference  10.  This  is  not  a  priori  an  integration  method,  but  it  is 
found  in  integration  methods  that  require  subroutines  involving  solution 
of  linear  equations. 

Let  the  matrix  Q  be  written  as  a  sum  of  upper  triangular,  diagonal, 

* 

and  lower  triangular  matrices 


Q  =  D  +  E  +  F 


(B-7) 


where  D  is  diagonal,  E  is  upper  triangular,  and  F  is  lower  triangular. 

In  fact,  the  very  same  general  approach  will  work  for  block  partitioned 
matrices  Q  (as  we  have  in  this  case),  for  which  D  is  taken  as  a  diagonal 
of  blocks  instead  of  scalars.  In  the  latter  case,  Reference  10  refers 
to  the  method  as  the  block  successive  overrelaxation  iterative  method. 

(k) 

Now,  suppose  that  a  trial  solution  vector  v  is  available.  The 
_  _  Jk+1)  - K.r 


next  trial  solution  vector  v 


is  defined  for  this  method  by 


(k+1) 


+  v(k)  £uF  -  (1  -  uj)d]  = 


(B-8a) 


where  u)  lies  in  the  range  0  u)  <  2  ,  and  is  called  a  relaxation  factor. 
The  above  relation  is  not  as  transparent  as  its  following  equivalent: 


^(k+l)  _  vU)j  j”D  +  aEj  _  _  v(k)QJ 


(B-8b) 


*  As  stated  earlier,  this  discussion  differs  somewhat  from  Reference  10 
in  notation  and  conventions. 
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In  other  words,  the  iteration  takes  the  error  vector,  if  any,  resulting 
from  trying  to  solve  Equation  ( B— 5)  and  causes  a  particular 


J 


Av 


(k) 


(k+l)  (k) 

v  -  v 


(B-9) 


to  reduce  that  error.  When  U)  =  1  ,  the  method  reduces  to  the  so-called 
Jacobi  iterative  method.  When  U)  >  1  ,  there  is  what  is  called  overrelaxa¬ 
tion,  i.e.,  "jumping  ahead  of  yourself,"  which  greatly  reduces  computation 
time.  Reference  10  develops  a  formula  for  the  optimal  relaxation  factor, 
which  depends  on  the  largest  eigenvalue  of  a  certain  associated  matrix. 

In  our  computations,  it  was  found  that  the  fixed  value  of  u  =  1.3  worked 
satisfactorily,  but  in  future  work  with  larger  flow  graphs  arising  from 
practical  problems  it  may  pay  to  determine  an  optimal  uu  . 


It  will  be  observed  that  Equation  (B-8)  does  not  give  v^<+1^ 

00 

explicitly  in  terms  of  v  and  fixed  data.  However,  the  fact  that  the 


matrix  D  +  uE  is  upper  triangular  allows  for  successive  calculation  of 
(k+l)  (k+l)  .  x  (k+1)  (k+l) 

/  ^  i*h/an  w  in  i'o  v*m  c  r\  -f  t  •  '  ^  ^  t 


v.  ,  then  v0  '  in  terms  of  v(”  '  ,  etc.,  until  v'  ’  '  is  calculated 


2  ---  --  -  1 
in  tei’ins  of  the  earlier  v''  's  . 


Now  we  come  to  the  actual  integration  steps.  As  implied  earlier, 
successive  overrelaxation  steps  were  used  to  solve  linear  equations  wi thin 
an  integration  step.  Rather  than  use  any  standard  available  numerical 
integration  routine,  it  was  decided  to  take  advantage  of  the  sparsity  of 
matrices  associated  with  this  model  by  preparing  a  special  purpose  computer 
program.  In  fact,  the  size  of  even  the  small-scale  prototype  model  would 
preclude  the  use  of  a  standard  general  purpose  routine.  The  integration 
steps  used  were  of  the  form: 


+  At) 


cp(  t)  e 


A  At 


(B-10) 
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In  view  o£  the  particular  sparse  structure  and  block  diagonal  form  of  the 
model,  the  use  of  a  Pade  approximation  to  the  exponential  of  the  matrix 
AAt  ,  in  the  form: 


AAt 

e 


( 

\ 


) 


(B-ll) 


i 


or  better  yet, 


(B-12) 


was  recommended.  Higher  order  approximations  were  considered  and  prepared 

for  coding  but  were  not  actually  used.  Their  use  may  be  of  value  in  larger 

practical  problems,  as  well  as  in  completion  of  calculations  for  the  last 

measure  of  effectiveness,  i.e.,  the  contact  time-in- the-sys tern,  which  was 

not  completed  in  time  for  inclusion  in  this  report.  The  exponential  of  a 

matrix,  incidentally,  arise  in  this  context  simply  because  the  formal 

solution  to  Equation  (A-14)  is  cp  =  <p  eAt  .  Numerically,  the  situation  is 

o 

not  that  simple,  however.  A  large  matrix  A  is  never  actually  exponen- 

tialed,  e.g.,  with  the  Taylor  series,  since  convergence  of  most  series 

AAt 

is  very  slow,  especially  for  certain  values  of  At  .  As  an  example,  e  , 

even  though  it  may  have  all  relatively  large  negative  real  parts  for  its 

eigenvalues,  would  take  incredibly  long  to  calculate  for  large  values  of 

At.  The  reader  may  wish  to  verify  this  for  himself  by  examining  the  series:  • 


-100  2 , 
e  =  1  -  100  +  100  /2  -  _ 

AAt 

Any  approximation  of  e  would  have  to  be  used  for  appropriately  con¬ 
fined  ranges  of  At.  In  this  case,  Equation  (B-12)  permitted  much  larger 


B-10 


increments  of  At  than  would  be  allowed  using  the  simple  approximation 
(used  in  Euler  integration): 


AAt  ~ 
e  = 


I  +  AAt 


Equation  (B-5)  arose  as  a  result  of  the  Pacle  approximation  approach 
to  integration  in  the  following  manner.  Taking  Equation  (B-ll)  as  a 
basis,  and  letting  t  be  some  time  in  the  process  of  integration,  we 
consider: 


g 


cp(t) 


Q  = 


I  - 


At 

2 


A 


v  =  cp(t  +  At) 


(B-13) 

(B-14) 


To  obtain  cp(  t  +  At)  from  cp(  t)  ,  Equation  (B-5)  is  solved  for  v  with 

(o)  .  . 

the  above  forms  for  Q  and  g  .  Setting  v  =  cp(t)  is  a  good  starting 
point  for  the  iteration.  For  the  illustrative  computations,  both  Equa¬ 
tion  (B-ll)  and  Equation  (B-12)  were  used,  and  it  required  only  about 

-5 

4  to  10  iterations  to  achieve  an  error  of  less  than  10  in  the  trial 

updated  probabilities  v^*^  .  The  only  effect  of  going  to  Equation  (B-12) 

j 

was  that  use  of  larger  At's  was  possible  without  a  reduction  in  accuracy 
than  when  using  Equation  (B-ll). 


3.  Using  the  Flow  Graph  Structure  to  Organize  Calculations  Efficiently 

Because  of  the  fact  that  the  matrix  A  for  this  particular  problem  is 
very  sparse,  all  data  are  stored  in  terms  of  arc-node  incidence  relations 
ior  the  appropriate  flow  graph,  depending  upon  which  measure  of  effective¬ 
ness  is  being  quantified.  In  the  case  of  system  unsaturated  time,  the 
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sparsity  was  actually  of  the  smallest  degree  since  this  case  led  to  a 
total  of  only  N  =  62  states. 


The  number  of  nonzero  a.,'s  for  a  given  i  in  Equation  (B-2)  is 

3  ^ 

anywhere  from  1  to  5  .  Actually,  any  number  of  a..'s  corresponding  to 

j 

incoming  arcs  might  have  been  non-zero  in  a  general  flow  graph,  even 
though  it  has  a  limited  number  of  outgoing  arcs  at  each  node,  but  the 
particular  periodic  sort  of  structure  of  the  single  element  model's  flow 


graphs  assures  no  more  than  5  arcs  coming  into  any  node  as  well  as  out 
of  any  node  except  for  output  nodes.  Because  of  this  special  structure 
of  all  of  the  flow  graphs,  no  matrix  algebra  was  performed  on  the  com¬ 


puter.  Rather,  we  stored  and  worked  with  lists  of  arc  factors,  doubly  in¬ 
dexed  arrays,  e.g.,  FACTOR(l,j)  ,  in  which  the  first  index  ran  from  1  to  N 
(the  total  number  of  nodes)  and  J  ran  from  1  to  5  .  This  led  to  a  great 
saving  in  computing  storage  and  effort  as  compared  to  using  a  general 
purpose  integration  scheme  that  would  require  manipulation  of  N  X  N 


matrices . 
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